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Objectives 


The general aim of this unit is to describe some practical methods of 
handling data in tabular form. 


After working through this unit you should be able to: 


(i) form difference tables and use them for interpolation and extra- 
polation ; 

(ii) explain what is meant by differencing a function, and be able to 
difference some elementary functions ; 

(iii) use difference methods to trace and correct blunders in a table of 
values; discuss the effects of inherent errors on difference tables; 
and judge how many differences may usefully be employed in the 
Gregory-Newton method; 

(iv) explain the principle involved in polynomial interpolation; 

(v) use the Gregory-Newton formula for numerical interpolation (you 
will not normally be expected to work beyond the quadratic approxi- 
mation); 

(vi) use difference methods to sum finite series of the form 


(a + br + cr’) 
=1 


r= 


where r takes integral values. 


N.B. 

Before working through this correspondence text, make sure you have 
read the general introduction to the mathematics course in the Study 
Guide, as this explains the philosophy underlying the whole course. You 
should also be familiar with the section which explains how a text is 
constructed and the meanings attached to the stars and other symbols 
in the margin, as this will help you to find your way through the text. 
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Linear Extrapolation 
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Glossary 


Terms which are defined in this glossary are printed in CAPITALS. 


BINOMIAL. 
EXPANSION 


COEFFICIENTS 


CONTINUOUS 


CUBIC FUNCTION 


CUBIC POLYNOMIAL 


DIFFERENCE 
OPERATOR 


DIFFERENCE TABLE 


EXTRAPOLATION 


FINITE DIFFERENCES 


FIRST DIFFERENCES 


FIT 


GREGORY-NEWTON 
FORMULA 


vi 


The BINOMIAL EXPANSION 1s the POLYNOMIAL identity 


n 


x" 2h2 i4 
2 


+ h" 


ix + hf = x” + "hh + | 


(See RB 9.) 


The constants in a POLYNOMIAL are called COEFFI- 
CIENTS. 


The term CONTINUOUS, as applied to a function 
in this text, means that the graph of the function is 
continuous in the sense that there are no breaks or 
jumps in the curve. (A more rigorous definition of 
continuity will be given in Unit 7, Sequences and 
Limits I.) 


A CUBIC FUNCTION is a POLYNOMIAL FUNCTION of 
degree 3. 


A CUBIC POLYNOMIAL is a POLYNOMIAL of degree 3. 


The DIFFERENCE OPERATOR for spacing h, denoted 
by A,, operates on the set of all REAL FUNCTIONS, 
F, as follows: 


Alf) = [xt-—>- f(x + h) — f(x] (feF) 


A DIFFERENCE TABLE 1s a table whose first column 
contains the TABULAR VALUES of a TABULATED 
FUNCTION, and whose succeeding columns contain 
FIRST DIFFERENCES, SECOND DIFFERENCES, etc. The 
TABULAR POINTS are usually evenly spaced. 


If x,5 .-. +X, are TABULAR POINTS of a TABULATED 
FUNCTION /, then EXTRAPOLATION is the estimation 
of the images under f of points outside the interval 
[Xm> X,], by means of a constructed function g which 
FITS f at the points x,,, ... X,- 


FINITE DIFFERENCES is a general term applied to 
FIRST DIFFERENCES, SECOND DIFFERENCES, etc., and 


also differences f(x.) — f(x,), f(x3) — f(x2), -.., 
where x,, X2,... are in ascending order but not 
necessarily evenly spaced. 


If x,,...xX, are evenly spaced TABULAR POINTS, 
with spacing h, for a TABULATED FUNCTION f, then 
the FIRST DIFFERENCES are the images of x,, .. . X,—1, 
under the function A, f, where A, is the DIFFERENCE 
OPERATOR for spacing h. 


A function g FITS a function f at points x,,...x, 
i o(x,) = f(x,), fork = FZ... CR. 


The GREGORY-NEWTON FORMULA for nth degree 
POLYNOMIAL INTERPOLATION to the function fis 


&(x) = f(x,) + OA, f(x) 
+400 — 1)AZ f(x) + --- 


1 
+7 00 — 1)(0 — 2)...@—n + LARS (x,) 
where x; Xp+15- +» Xe+n are evenly spaced TABULAR 


POINTS with spacing A, and 9 = ~~ *& ,0<0< 1. 
Xp 41-% 
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INTERPOLATION 


LAGRANGE S$ 
INTERPOLATION 
POLYNOMIAL 


LINEAR 
EXTRAPOLATION 


LINEAR FUNCTION 


LINEAR 
INTERPOLATION 


MEAN 
PROPORTIONAL 
PARTS 


NEW TON-GREGORY 
FORMULA 


nth DIFFERENCES 


nth DIFFERENCE 
OPERATOR 


PERIODIC FUNCTION 


POLYNOMIAL 


POLYNOMIAL 
EXTRAPOLATION 


POLYNOMIAL 
FUNCTION 


POLYNOMIAL 
INTERPOLATION 


If Xm>-+-+X, are TABULAR POINTS of a TABULATED 
FUNCTION /, then INTERPOLATION is the estimation of 
the images under f of certain points inside the 
interval [x,,,, x, | by means of a constructed function 
g which Fits fat the points x,,, .. . X,- 


If Xz, Xc+1> Xp+2 are three TABULAR POINTS of a 
TABULATED FUNCTION f, then the _ following 
QUADRATIC POLYNOMIAL 1s called LAGRANGE’ S INTER- 
POLATION POLYNOMIAL, and FITS f at X;, Xx4.15 Xx42 


(X. — Mp aX — 2% 49) 
(X_ = Xp4 (0% — Xa 


(X ~— XK —- Xp 9) 
as ae — X4)(Xpa1 — yore? 


(X = XX — X41) 
ge — X)%42 — Xe 1 Mee?) 


q(x) = 


LINEAR EXTRAPOLATION 1S EXTRAPOLATION by means 
of a LINEAR FUNCTION. 


A LINEAR FUNCTION iS a POLYNOMIAL FUNCTION of 
degree 1; i.e. a function whose graph 1s a straight 
line. 


LINEAR INTERPOLATION iS INTERPOLATION by means 
of a LINEAR FUNCTION. 


MEAN PROPORTIONAL PARTS are PROPORTIONAL PARTS 
averaged over a group of TABULAR POINTS. 


See GREGORY-NEWTON FORMULA. 


If x,,...X,, are evenly spaced. TABULAR POINTS, 

with spacing h, of a TABULATED FUNCTION f, and 

if m > n, then the nth DIFFERENCES are the images 

of x1, X2,..+Xm-—, under the function Aj f, where 
, is the nth DIFFERENCE OPERATOR for spacing h. 


The nth DIFFERENCE OPERATOR for spacing Ah, 
denoted by Aj, operates on the set of all REAL 
FUNCTIONS and is the n-fold composition of the 
DIFFERENCE OPERATOR A, with itself, 1.e. 


Ay = Aye Aye---9 Ay 


A function f with domain R is said to be PERIODIC 
with period hif f(x + h) = f(x) forall x e€ R, where 
he R is the smallest positive number for which this 
equation holds. 


A POLYNOMIAL of degree 7 in x is an expression of 
the form a,x" + a,—,x""' + +++ + ao, where x is 
regarded as a variable, a,,...d 9 as constants, and 
a, ¢ %, 

POLYNOMIAL EXTRAPOLATION 1S EXTRAPOLATION by 
means of a POLYNOMIAL FUNCTION. 


A POLYNOMIAL FUNCTION of degree v is a function 
of the form x+——> f(x); where f(x) is a POLY- 
NOMIAL of degree 1 in x, and the domain of fis R 
or a subset of R. 


POLYNOMIAL INTERPOLATION iS INTERPOLATION by 
means of a POLYNOMIAL FUNCTION. 
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QUADRATIC 
FUNCTION 


QUADRATIC 
POLYNOMIAL 


QUARTIC 
REAL FUNCTION 


SECOND 
DIFFERENCES 


TABULATED 
FUNCTION 


TABULAR POINTS 


TABULAR VALUES 


Vill 


The term 0{ f(x, + h) — f(x,)} in LINEAR INTER- 
POLATION is called the PROPORTIONAL PART for the 
value of @. In some tables, proportional parts are 
tabulated too, usually for 8 = 0.1, 0.2,..., 0.9. 


A QUADRATIC FUNCTION 1s a POLYNOMIAL FUNCTION 
of degree 2. 


A QUADRATIC POLYNOMIAL iS a POLYNOMIAL of 
degree 2. 


A QUARTIC is a POLYNOMIAL of degree 4. 


A REAL FUNCTION is a function whose domain and 
codomain are R or subsets of R. 


See nth DIFFERENCES. 


A TABULATED FUNCTION is a REAL FUNCTION, certain 
of whose values have been tabulated. 


If fis a TABULATED FUNCTION, whose images have 
been tabulated corresponding to elements x,,... x, 
in the domain, then x,,...x, are called TABULAR 
POINTS (or tabular arguments). 


TABULAR VALUES are the images, under a TABULATED 
FUNCTION, of the TABULAR POINTS. 


30 


30 


a2 
23 
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Notation 


The symbols are presented in the order in which they appear in the text. 


R 

log x 
j:e-- b 
aceA 

Y i 

sin Xx 
COS x 
axb 


[a, 5] 


A, 

A,(f) or A, f 
F 

fieh, 

Ay 


The set of real numbers. 

The logarithm of x, to base 10 (see RB //). 

The image of a under the function f is b. 

The element a belongs to set A. 

The set of positive integers. 

The image of x under the function sin (see RB 2). 
The image of x under the function cos (see RB 2). 
a 1s approximately equal to b. 


The subset of R consisting of all numbers between, and 
including, a and b. 


The difference operator for the spacing h. 

The function which is the image of the function f under A,. 
The set of real functions. 

The composition of functions f, and f, (see Unit /). 

The nth difference operator for the spacing h. 

A binary operation (see Unit 3). 

The function f:x-—— 0 (xe R). 

a is greater than b. 

The image of x under the function tan (see RB 2). 


The sum, )° r”, of the mth powers of the first n positive 
r=1 


integers. 
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4.0 INTRODUCTION 


The principal aim of this unit is to tell you how to work with a function 
for which a number of elements of its graph have been calculated or 
given. The concept of a function was explained in Unit /, Functions; 
here we are concerned with functions whose domain and codomain are 
both sets of real numbers (i.e. R or subsets of R). In principle, given any 
x belonging to the domain, it is always possible to find the image of x 
by applying the rule by which the function is defined. In practice, however, 
it may not be possible to use this method every time an image under the 
function is required: the rule may be too complicated to apply con- 
veniently, or in some cases it may not even be known. In such cases it 
may be that the images (or even approximate values of the images) of 
some particular numbers x,,x,,X3,..., in the domain can be found 
and in this case these images can be listed together with x,,x,,X3,..., 
in the form of a table. Such a table is a subset of the graph of the function. 
The most familiar examples of such tables are the tables of logarithms 
and of trigonometrical functions which we learn to use at school. 


x log x 
1.0 0.0000 
1.1 0.0414 
1.2 0.0792 
13 041139 
14 0.1461 
1S B76) 


We often face the problem of estimating images of values of x that are 
not tabulated: for example, can we, if necessary, obtain an accurate 
value of log 1.05, or of log 1.6, from the values given in Table I? This is 
the type of problem with which we shall deal. 


For functions such as the logarithm, sine or cosine, the use of tables is a 
matter of convenience only: with the aid of a computer we can calculate 
the logarithm or sine or cosine of a number without using any tables 
(the way it is done will be explained in Unit 14, Sequences and Limits II). 
Many functions, however, are formed from much more complicated 
rules than the one defining the logarithm: an example would be the 
function: 


Position on an Net upward force on unit area 
aeroplane wing of the wing at that position 


To calculate the images under this function for a given aeroplane wing 
(under given conditions of flight), even at a few dozen positions on the 
wing, would be a major computing project, and the more positions were 
taken the more costly the project would be. It is therefore much more 
practical to tabulate the images under the function at not too many 
positions and use the methods of this unit to estimate the images at other 
positions. Thus the computer revolution has not made the techniques for 
working with tabulated functions (i.e. functions for which a subset of 
its graph is specified by a table) obsolete; rather, it has greatly extended 
the range of functions to which it is possible to apply them. 


There are other situations too in which we may come across tabulated 
functions. The tabulated function may result from a sequence of 
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Table I 


experimental observations, as for example, in the tables used by engineers 
for designing steam engines. Here is an extract from such a table*: 


Pressure Boiling Point of Water 


(Ibf/in2) (°F) 
300 417.33 
350 431.72 
400 444.59 
450 456.28 


In this case the function is defined by a physical relationship rather than 
by a mathematical one such as the logarithm, but the domain and co- 
domain of the function are again subsets of R, and so the method of using 
the table is just the same as before. An engineer who needed the boiling 
point of water at a pressure of say, 325 lbf/in* could estimate it from 
Table II using the same methods as one uses to estimate log 1.05 from 
Table I. This problem of estimating the image of a number lying between 
two of the tabulated numbers in the domain is called the problem of 
interpolation. One of the objectives of this unit is to show you accurate 
and convenient methods for doing interpolation. 


A third type of function that can be tabulated is one that you will have 
come across if you have ever done an intelligence test. A simple example 
of a question in such a test is the following: 


What is the next number in the sequence 
it SS Sy 


This sequence can be regarded as a list of image values of a function, call 
it f, where 


f:n*—— (nth number in sequence), (ne Z*), 


where Z” is the set of positive integers. It therefore corresponds to a table 


n nth number in sequence 
1 1 
2 3 
3 5 
4 7 
5 9 


The problem set in this intelligence test is to discover the value of f(5), 
that is, the next entry in the table. This is a problem of a similar nature 
to interpolation except that the element of the domain whose image we 
are trying to estimate lies not between two of the tabulated values but 
beyond the last one tabulated. The problem of estimating the images 
under the function for elements of the domain outside the tabulated 
range is called the problem of extrapolation. Another example of ex- 
trapolation is the problem of obtaining log 1.6 from Table I. A second 
objective of this unit is to teach you how to extrapolate. 

Looking at the I.Q. test question shown in Sequence (1), you probably 
feel that the first missing number in the sequence is 9. How did you arrive 
at this? You may have reasoned that the second number in the sequence 
is 2 greater than the first, that the third is 2 greater than the second, that 


* ©. W. Eshbach, Handbook of Engineering Fundamentals, (John Wiley 1966). 


FM 4.0 


Table If 


Definition { 
xk * 


Sequence (1) 


Definition 2 


x 


the fourth is 2 greater than the third, and hence that the fifth is probably 
2 greater than the fourth. If you did reason this way, you have already 
grasped the basic idea of the method that gives this unit its title, namely 
the method of finite differences. In this method we focus attention on 
the differences between the successive numbers in a sequence of images 
under a function. These differences are called finite differences to 
distinguish them from other differences considered in a later unit. In this 
later unit, Unit 12, Differentiation I, we take the difference of images of 
numbers in the domain that are allowed to be arbitrarily close together, 
whereas in the subject of finite differences, the difference between them 
is kept fixed. Because of the link with differentiation, your study of finite 
differences in the present unit will provide you with a useful introduction 
to some of the ideas of Differentiation I and the other units on calculus, 
while avoiding for the present the extra conceptual apparatus (the concept 
of limit) that is needed to deal with quantities that are allowed to be 
arbitrarily close together. 


Since digital computers are well suited to finite differences, there are 
processes which used to be calculated using calculus and are now, in 
some cases, calculated with the aid of finite differences. 


4.1 LINEAR INTERPOLATION AND 
EXTRAPOLATION 


4.1.1 The Need for an Assumption 


Every method of interpolation or extrapolation depends on an assumption 
about the nature of the function that has been tabulated. For example, in 
the I.Q. test question we have already mentioned: 


‘What is the next number in the sequence 
oe cscs 


the obvious answer is 9, since the numbers appear to be formed from the 
rule: “‘to find the next number, add 2’’; in other words they form an 
arithmetic progression (sequence) 


a,a+d,a+ 2d,a + 3d,... 


with a = | and d = 2. But is it really as simple as that? Why shouldn’t 
the answer be 11? The numbers given in Sequence (1) might be the first 
four in a longer sequence that continues: 


1, 3 De ee, 27, 31,.... 


Just by looking at the four numbers 1, 3, 5,7, we have no way of telling 
whether they come from the arithmetic sequence (2), or from the more 
complicated sequence (3). It is thought, both by the setters of intelligence 
tests and by those who have the misfortune to have to answer them, 
that the ‘“‘reasonable”’ choice is the arithmetic sequence, perhaps on 
some such ground as that the only numbers appearing in the rule deter- 
mining it can be found from the given numbers 1, 3, 5,7. But can we be 
sure that there would in every case be just one ‘“‘reasonable’”’ choice? 


This problem typifies a situation that we shall meet again and again in 
this unit. In order to do an interpolation or (as here) an extrapolation, it 
is necessary first to find a simple function that has the same image values 
as the tabulated function at the tabulated elements in the domain. In the 
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4.1.1 


Discussion 
x 


Sequence (1) 


Sequence (2) 


Sequence (3) 
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intelligence test example, there is a fair chance of guessing the unique 
function that the test setter happened to have in mind, but in general, 
since the whole point of the interpolation is often to approximate a 
complicated function by a simpler one, there will be no unique way of 
choosing the simple function. 


The following example should help to clarify the last sentence. 


Example 1 Example 1 
A part of a table for the sine function 
x-—sinx (xéER) 


is shown below. 


x sin x 
—0.4 — 0.39 
—0.3 — 0.30 
— 0.2 — 0.20 
—0.1 —0.10 

0 0 

0.1 0.10 
0.2 0.20 
0.3 ee i 
0.4 0.39 


(The values of x are given in radians and the corresponding images are 
given to two significant figures.) 


Now, it would seem reasonably clear that for any element in the restricted 
domain [—0.4, 0.4], the function x-—— x has approximately the same 
image as x sin x. Therefore, if we were only interested in this restricted 
domain for the sine function, we could safely approximate the complicated 
function : | 

x sinr (x € [ —0.4, 0.4]) 
by the simple function 

gieney (x e [—0.4, 0.4]) 


However, as we said above, this approximation is not unique : for instance, 
you will find that both 


x-— cos 5 ee (x € [—0.4, 0.4]) 


and 


3 
Ye = (x €[—0.4, 0.4]) 


are also approximations to the sine mapping with this restricted domain 


2 
non-uniqueness is not something we can get rid of, as you can readily 
appreciate by considering attaching precise meanings to ‘“‘complicated”’, 
“‘simple’’ and ‘‘approximate”’. & 


(the first happens to be exact, in that cos il | = sin x, (xe€ R)). The 


As a consequence of the non-uniqueness, there are different methods of 
interpolation and extrapolation, which may well yield different results. 
There is no absolute criterion for choosing between these methods, 
except that, when the result is to be applied to, say, an engineering con- 
struction, we have a criterion of sorts: does it work? All that can be done 


is to use whatever information we have about the source of the tabulated 
numbers and to choose the new function in the simplest way that is 
likely to yield a good approximate representation of the original function. 
In order to make a good choice it is important to be able to estimate the 
error in an interpolation or extrapolation method. Later in the unit we 
shall discuss briefly how this can be done. 


We have mentioned that it is important to know where the tabulated 
numbers come from. The most important use of this information is to 
tell us whether the tabulated function is sufficiently regular to justify 
applying interpolation or extrapolation methods at all. In the introduction 
we mentioned several examples of such “regular’’ functions : the logarithm, 
two functions arising in engineering, and a sequence of numbers in an 
intelligence test. There are, however, functions whose behaviour is much 
less regular and for which the methods described in this unit are not 
normally suitable. These are functions in which a large unpredictable 
or chance element takes a part. An extreme example is the sequence 
of numbers obtained by throwing a die or spinning a roulette wheel a 
large number of times. Here (fortunately for the casino owners) even the 
most sophisticated extrapolation techniques will not help you to predict 
the next number in the sequence. 


Perhaps the word “‘predict”’ as used above needs qualifying. If we throw 
an unbiassed die, we can be certain that we shall get one of the results 
1, 2, 3, 4, 5 or 6, and in a large number of throws any repeated guess of 
one of these six numbers would be right roughly one time in six. But this 
is not the same as saying that if the first seven throws give the sequence 


6, 3, 6, 2, 1,4, 4 


then the next throw will give a 5. There is no law governing this sequence: 
each of the six numbers is equally likely to occur at the next throw. This 
and other similar types of sequence can be loosely classified as “‘statistical 
sequences’’. Finite difference methods of interpolation and extrapolation 
cannot be applied to this type of sequence. They are inappropriate, 
because to use these methods we have to make some assumption about 
the rule of formation of the sequence. By the very nature of the random- 
ness implied in throwing a die, we cannot make this type of assumption 
for statistical sequences. We shall return to the study of this type of 
sequence in Unit 16, Probability and Statistics I. 


Statistical sequences of a less extreme type are supplied by economic 
data such as quarterly trade figures, or stock exchange prices. For example, 
here is a table of the price of shares in Consolidated Gold Fields during 
the week 9th—16th August 1968: 


Day Price Change 
Fri 9th August 66/6 
Mon 12th August 68 /— +1/6 
Tues 13th August 69/— +1/- 
Wed 14th August 70/- +1/- 
Thur 15th August 72/- +2/- 
Fri 16th August 74/- +2/- 


The art of making money on the Stock Exchange is the art of predicting 
the behaviour of a sequence like the one in the table; but although the 
numbers in the table are not random like the ones given by casting a 
die, it is hardly possible to predict the sequence by finite difference 
methods. The numbers in the ‘“‘change”’ column (what we are calling 
“differences” in this unit) are all at least 1/-, which might lead one to 
expect that the numbers would continue to increase steadily, perhaps by 
a further 5 to 10 shillings in the next week. In fact, at the end of the next 
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week the price was the same as on the 16th, and by the end of the following 
week it was back to 69/—-. Regrettably, we cannot promise you that a 
study of this unit will help you to make your fortune on the Stock Ex- 
change. This is because share prices are determined by many other factors 
besides the ones shown in the table. Of course there are “‘trends’’, but 
these can only be identified reliably by other methods; we shall return 
to this question in the units on probability and statistics. 


The main conclusion to be drawn from the discussion in this section is 
that interpolation and extrapolation methods work best when the table 
of numbers under consideration comes from a well-defined mathematical 
or empirical function which may be expected to lead to a fairly regular 
pattern of variation in the image values. We begin by looking at some 
cases where this pattern is simple enough to be approximated by a 
linear function, that is, one whose graph is a straight line. One example 
which we assumed to be of this type has already been considered: the 
extrapolation of the sequence 1, 3, 5, 7,... for which the relevant function 


k+——> (kth number in sequence) 


has the following graph: 


k** number 
in sequence 


9 o¢— Extrapolated 


Given points 


In the next section we shall consider the corresponding interpolation 
method. 
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Exercise 1 


Write a paragraph discussing the applicability of Finite Difference 
methods to the following tabulated data. 


Chemical Element § Atomic Number Atomic Weight 


Manganese 25 54.93 
Iron 26 55.85 
Cobalt 27 58.94 
Nickel 28 58.69 
Copper Pas 63.54 
Zinc 30 65.38 
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Pitch of Musical Note Vibration Frequency 


Middle C 256 
D 288 
E 320 
F 3414 
G 384 
A 4262 
B 4902 
C 512 


Thousands of men under arms: Army, Navy and Air Force 


Year Britain France Russia U.S.A. Germany Italy 


1914 397 834 1254 165 864 345 
1924 349 835 678 251 114 359 
1932 316 690 562 237 114 324 


1939 460 864 2269 334 1182 1077 
1949 770 589 4000 1616 — ? 
1955 803 950 4500 2935 — ? 


i ee eas ee 


* Sir James Jeans, Science and Music, (Cambridge University Press 1961). 
+ P. J. Noel-Baker, The Arms Race, (Oceana Publications 1956). 
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Exercise 1 
(10 minutes) 


Solution ] 


For each of the three tables your answer should consider these questions: 


(i) Are the tabulated values (elements of the codomain of some unspecified 
function) determined by the tabular points (elements of the domain 
of this function) in accordance with some mathematical, scientific, or 
other natural law, or are they significantly affected by other factors 
(including chance)? 

(ii) If the answer to (i) is that they are determined in accordance with 
some law, is this law simple and regular enough for us to approximate 
it by a simple mathematical expression obtained from the numbers in 
the table? 


In the chemical] example,: there is undoubtedly a scientific law, but it is 
not regular enough to justify the use of finite difference methods (notice 
how the atomic weights mostly increase with atomic number, but slip 
back between Cobalt and Nickel). In the musical example, the frequencies 
of vibration are’ determined by the notes in accordance with acoustical 
laws, and the law is regular enough to justify using finite difference 
methods ; in fact, since the invention of the equally tempered scale (which 
is a good approximation to the diatonic scale given in the exercise), the 
Standard method of tuning a piano has been based on a simple mathe- 
matical formula (each semitone corresponds to a factor of 2 or 1.059, 
in frequency). In the military example, the size of a country’s armed 
forces is undoubtedly influenced by factors other than the mere passage 
of time and the sizes of other countries’ armed forces; and so the table 
(like the table of share prices in the text) does not give enough information 
to justify the use of finite difference methods; question (ii) does not 
apply in this last case. # 
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Solution 1 
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4.1.2 Linear Interpolation 


The simplest method of interpolation is one that is widely used in tables 
of elementary functions, such as log tables. In the introduction to this 
unit, for example, we mentioned the problem of finding log 1.05 from the 
following table: 


x log x 
1.0 0.0000 
11 0.0414 
l2 072 
i>. BAI 
14 0.1461 
15 0.1761 


Since 1.05 is half way between 1.00 and 1.10, the simplest estimate is to 
assume that log 1.05 is half way between log 1.00 and log 1.10, that is 


0.0000 + 0.0414 


5 = 0.0207 


log 1.05 = 


This agrees to 3 decimal places with the value 0.0212 given in four-figure 
log tables. (This latter value is itself correct only to 4 decimal places; 
the exact value of log 1.05 is a non-terminating decimal.) In a similar way, 
to find log 1.13, since 1.13 is 335 of the way from 1.10 to 1.20, the simplest 
estimate is log 1.10 plus 33; of the distance to be covered in going from 
log 1.10 to log 1.20, that is 


log 1.13 ~ log 1.10 + ;4(log 1.20 — log 1.10) 
= 0.0414 + 3,(0.0792 — 0.0414) 
== 0.0527 


This agrees to 3 decimal places with the value 0.0531 given in four-figure 
tables. 


The method used in deriving Equations (1) and (2) is sometimes called 
the method of proportional parts, since the number on the right-hand 
side of Equation (2) divides the interval [log 1.10, log 1.20] in the same 
proportion that the number 1.13 divides the interval [1.10, 1.20]. To 


log 
1.00 .0000 
1.05 (ee 
1.10 .0414 
1.13 ¢——— 
1.20 -.0792 


deal with the general case, let us denote the tabulated function by f 
and the numbers in the domain for which it is tabulated by x,,x,,...X,, 
arranged in increasing order. These are known as tabular points. The 
images of these points are then f(x,), f(x,),...,f(x,); they are called 
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4.1.2 


Discussion 
teh 


Table I 


Equation (1) 


Equation (2) 


Main Text 


zk k 


Definition 1 


x kee 


tabular values of the function. For brevity we shall denote the tabular 
values by y,, 2,--+s Yn: 


x f(x) 

xy Sass f(x) 
X2 V2 = f (x2) 
Xn Yn ses FT (x,) 


To estimate f(x) when x lies between the two tabular points x, and x, 
say, we find the proportion in which. the number x divides the interval 
[x,,X,] and find the number y that divides the interval [y,, y.] in the 
same proportion. We can represent the procedure graphically: 


B Graph of f 


The proportion in which the number x divides the interval [x,, x,] is 


BA Xy Se AD 
t.=%, AG 

Using the fact that triangles ADE and ACB are similar, we have 
AD _ DE 
AC CB 


Since CB is the length of the interval [y,, y,], E is the point whose y-co- 
ordinate divides the interval [y,, y,} in the required proportion. So we 
see that our method of estimating f(x) between A and B is to approximate 
its graph by a straight line between the two points. For this reason this 
method is called linear interpolation. 


Some published tables give a little help in the method of linear interpola- 
tion by printing the values of y,,, — y, to the right of the values of y, 
and y,,,, and on a line halfway between them, as for example in the 
following extract from a table of reciprocals: 


x 1/x 
1.60 0.6250 _ 39 
1.61 0.6211 _ 38 
1.62 0.6173 _ 39 
1.63 0.6135 


The numbers — 39, —38, —38, known as first differences, should really 
be —0.0039, —0.0038, —0.0038, but they are usually printed as shown 
(or even without the minus sign) to save space. 
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Exercise 1 Exercise | 
(3 minutes) 
Use linear interpolation to obtain approximate values for 
(i) log 1.25, using Table I in Section 4.1.2; 
(ii) the boiling point of water at a pressure of 365 Ibf/in? from the following 
table 
Pressure Boiling Point of Water 
(Ibf/in?) EP) 
300 417.33 
350 431.72 
400 444.59 
450 456.28 
: e 
The method of linear interpolation can be applied to any table whatever, Discussion 
but only in suitable cases can we rely on the values so obtained. The 
criterion is that the graph of the function should be approximately straight 
between the tabular points. 
Exercise 2 Exercise 2 
P (3 minutes) 
Tabulate the values of sin x for x = 0, z, 22, 3m radians, and calculate a 
value of sin 2 by linear interpolation. What do-you conclude? * 
Exercise 3 Exercise 3 
(3 minutes) 
; mn 32 
(i) Tabulate the values of sin x for x = 0,7) oe and z, and calculate 


Age 
a value for sin 10 by linear interpolation. 


(ii) Calculate a value for sin = by 


¥ sin x 
linear interpolation from the 
table at the right. 0 0 
7 
— 0.1951 
16 
2n 
a 0.3827 
16 
3n 
— 0.5555 
16 
= 0.7071 
16 


(iii) To four places of decimals, the value of sin 75 is 0.3090. What do you 


conclude by comparing this with the results of the preceding exercise 
and (1) and (11) of the present exercise? a 


Solution 1 
(i) 0.0966 
(ii) 435.58 °F. & 
Solution 2 
¥ 0 HA 2n 32 
sin x 0 0 0 0 


Linear interpolation gives sin as 0. Indeed, linear interpolation gives 


sin x = 0 for all values of x between 0 and 3z. The conclusion is that 
linear interpolation can give wildly inaccurate results if the interval of 
tabulation is too large. One may conclude also that extreme care must 
be taken in cases where little is known about the function being tabulated. 

® 


Solution 3 


(i) 


x sin x 

0 0.0000 
3 0.7071 
: 1.0000 
3 

= 0.7071 
1 0.0000 


The interpolated value for x = “_ is 0.0000 + (0.7071 — 0.0000)9, 


with 
7 
* eee 
@ = 2. 
= 0 10 
4 
4 | 
= 0.0000 + 0.7071 x rT ta 0.2828 
(ii) The interpolated value for x = = 1S 
‘ uw : 7 : Tl 
sin =] + sin (27 — sin i) |e 
with 
1 7 
ee. Ss 
- ae uz = 
16 16 


= 0.1951 + 0.1876 x a = 0.3077 


(iii) The interpolated values get closer to the given four-figure value as 
we reduce the interval between the tabular points. sf 
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Solution 1 


Solution 2 


Solution 3 
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Exercise 2 illustrates a case where linear interpolation is completely Discussion 
inappropriate : the sine function cannot be satisfactorily represented by a ; 
straight line joining tabular points as far apart as 0 and 7, as is obvious 

from the figure. 


sin x 


Graph of x — sin x 


Linear 
Interpolation 


4 


On the other hand, Exercise 3 shows two cases where the tabular points 
are closer together and where linear interpolation gives fairly good 


results. In (i) the spacing between tabular points is 7 and the interpolation 
is in error by 0.3090 — 0.2828 = 0.0262; in (ii) the interval width is only 


2 and the interpolation is in error by only 0.3090 — 0.3077 = 0.0013. 
Thus, in this example, the accuracy of linear interpolation is generally 
better, the closer together the tabular points. This is illustrated in the 


figure. 


sin x 


Graph of x > Sin x 


interpolation with interval = 


interpolation with interval _ 


ee Me 


16 16 


In designing mathematical tables such as log tables the tabular spacing 
is usually chosen small enough to make the error in linear interpolation 
no greater than the round-off error in the tabulated figures. This implies 
that a higher accuracy in the tables demands a smaller tabular spacing 
and hence more tabular entries. For example, in Chambers’s Four-Figure 
Tables the logarithms occupy 4 pages, but in Chambers’s Six-Figure 
Tables, (100 times as accurate), they occupy 26 pages. In four-figure 
tables it is customary to make the interpolation more convenient, at 
some cost in accuracy, by replacing the proportional parts by mean 
proportional parts, which are simply proportional parts averaged over 
a group of tabular intervals (instead of taking the nearest tabular points). 
For example, in the table of reciprocals on page 15, the mean proportional 
part under the number 2 in the table is obtained as 


(5882 — 6250) 2 736 


10 io a 


(The minus sign is not shown in the table for brevity ; you are expected to 


1 
remember to subtract, since = decreases as x increases.) 


So whether you are reading the reciprocal of 16.12 or of 16.72 you use 
the same mean proportional part, i.e. — 7. Whereas, if you were to use the 
nearest tabulated points, you would use linear interpolation on the 
tabulated values at 16.1 and 16.2 for 16.12, obtaining the true proportional 
part, 0.2(6173 — 6211) = —8, rather than —7, and on the tabulated 
values at 16.7 and 16.8 for 16.72, obtaining the true proportional part 
0.2(5952 — 5988) = —7. 


Exercise 4 


Using the table of reciprocals, read off the reciprocals of 1.66 and 1.67 
(in such tables you are often expected to find the position of the decimal 
point for yourself). By linear interpolation, obtain a value for the reciprocal 
of 1.667. Also obtain a value for the reciprocal using the mean proportional 
parts shown, and explain any discrepancy. = 
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Definition 5 


Exercise 4 
(S minutes) 


Table of Reciprocals 


16 | 6250 6211 6173 6135 6098 6061 6024 5988 5952 5917 


Mean Proportional Parts 


Se Se eee Se eee ee 
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Solution 4 Solution 4 
1/1.66 = 0.6024, 1/1.67 = 0.5988 
Linear interpolation 
1/1.667 ~ 0.6024 + (0.5988 — 0.6024)6 
with 
1G > 1 Ft 
167-—1.66 10 


7 
so that 1/1.667 ~ 0.6024 — 0.0036 x -" 0.5999 


Mean proportional parts 
1/1.667 ~ 0.6024 — 0.0026 = 0.5998 


(Mean proportional part for 8 = 75 is shown in the table as 26.) 


The results obtained using mean proportional parts are slightly inaccurate 
because the proportional parts for <5 vary between 


(6250 — 6211) x 7 = 27 
and 
(5952 — 5917) x 75 = 24 


across the table, so that using the mean value 26 can introduce an error 


of up to 2 digits in the last decimal place. a 
4.1.3 Extrapolation | 4.1.3 
The most important thing to know about extrapolation is that it may be Main Text 


xk & 


considerably less accurate than interpolation. For linear extrapolation 
this can be seen from the figure below, which shows the graph of a function 
together with the straight line crossing it at two tabular points x, and 
X,41- For values of x within the interval [x,,x,4,], this straight line 
corresponds to the interpolation formula given in the preceding section 
and can be quite accurate if the interval is not too wide. If, however, 
the straight line is used for extrapolation, that is outside this interval, 
the accuracy falls away rapidly. 


f (x) 


Smaller 
Error 


sao 
ooo” 
one 


approximation 


Extrapolation Xe interpolation Xx th Extrapolation 


range range range 


For this reason, if there is a choice between interpolation and extrapola- 
tion, interpolation is always preferable. Sometimes, however, we cannot 
avoid an extrapolation. This can occur, for example, if we are calculating 
successive entries in a table of some new function, and we need a rough 
estimate of the next entry in the table to use as the first approximation 
in an iterative process for calculating it accurately. This is the problem 
we shall consider here : given an incomplete table of a function, to estimate 
the next entry in the table. 


We have already considered one problem of this type, the intelligence 
test question of guessing the next number in the sequence 1, 3, 5,7,.... 
The method by which you solved this problem can be systematized 
by tabulating the sequence and recording the differences of successive 
tabular values just as in printed tables laid out for linear interpolation : 


k kth number 
in sequence 


Un B&B Wh — 
Or~YyMn wo = 
NM hh bo 


The column of 2’s comprises the differences of successive numbers in the 
sequence. The natural way to continue this column is to insert a further 2 : 
this implies that the next entry in the sequence should be a 9. This is an 
example of linear extrapolation, a process which can be used whenever 
the entries in the column of differences are all the same. 


Exercise ] 


Use linear extrapolation to find estimates for the missing tabular values 
in the following table. 


x sin x 
29° 54’ 
30° 0.5000 
30° 6’ 0.5015 
a 12 0.5030 
30° 18’ 0.5045 
30° 24’ 


A less trivial extrapolation problem is provided by the table of stopping 
distances printed in the back of the Highway Code: 


Speed Stopping Distance 


(mile/h) (ft) 
20 40 
30 75 
40 120 
50 79 
60 240 


17 
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Exercise 1 
(2 minutes) 
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Table I 


(continued ‘on page 18) 


Solution 1 


Linear extrapolation gives sin (30° 24’) = 0.5060 and sin (29° 54’) = 0.4985. 
e 


(continued from page 17) 


Suppose your driving test examiner had asked you the stopping distance 
for 70 mile/h, or for 10 mile/h. Here is a way to estimate them. Once 
again we form the column of differences 


40 


35 
75 
45 
120 
55 
175 65 
240 


This time the differences are not equal, but it is fairly easy to guess the next 
entry in the column of differences, and so to complete the solution. 


Exercise 2 
What is the stopping distance for a speed of 70 mile/h? a 
(The answer to this exercise is contained in the text which follows.) 


The differences in Table II form an arithmetic sequence with common 
difference 10; therefore the natural way to continue the difference column 
is to make the next entry 75. Then the next entry in the stopping-distance 
column must be 315, since 315 — 240 = 75. The process by which we 
obtained 75 as the next entry in the difference column can be systematized 
by constructing a further column of numbers, the differences of successive 
entries in the difference column. These are called the second differences 
of the original sequence of stopping distances. With the second differences 
included the table looks like this 


i Stopping First Second 
Speed Distance Differences Differences 

20 40 

30 fe ye 10 
40 120 55 10 
50 175 65 10 
60 240 - 75 10 
70 315 


i 


Since the second differences of the given numbers are all 10, we expect 
the next entry in the second difference column also to be 10 and the other 
red figures are then determined by solving the equations 


75—65=10 and 315-240 = 75 


The array of numbers in the last three columns of Table III is called a 
difference table. s 


FM 4.1.3 


Solution 1 


Table I 


Exercise 2 
(2 minutes) 
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Definition 2 
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Exercise 3 
Use the Highway Code figures to estimate stopping distances for speeds 
of 80, 10 and 0 mile/h. £ 
Exercise 4 


Here is part of a table of squares. Form a difference 


table for it and hence estimate 377 by extrapolation. x x" 
be 961 
32 1024 
33 1089 
34 1156 
35 1225 
36 1296 
a7 ? 
2 
Exercise 5 


The images under a function f are tabulated for equally spaced values 
of the variable. If the second differences are 


(i) all zero, 
(11) not all zero, 


what can you deduce about the graph of the function? s 


Exercise 6 (Omit if you got Exercise 5 completely right). 
Tabulate the images under the function 
x-—x + sinnmx (xeER) 


for x = 0,1, 2,3,and compute the second differences of this table. Evaluate 
the images also for x = 4,3, 3, and hence sketch the graph of the function. 
This is an example of a table with zero second differences from a function 
that is not linear. Pg 
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Exercise 3 
(2 minutes) 


Exercise 4 
(2 minutes) 


Exercise 5 
(5 minutes) 


Exercise 6 
(3 minutes) 


Solution 3 

From the table we obtain the following estimates: 
at 80 mile/h estimated stopping distance is 400 feet. 
at 10 mile/h estimated stopping distance is 15 feet. 


at 0 mile/h estimated stopping distance is 0 feet. we 
Solution 4 
First Second 

x x? Differences Differences 

31 961 

32 1024 se 2 

33 1089 67 2 

34 1156 69 2 

35 1225 71 Zz 

36 1296 73 2 

Le: 1369 

* 

Solution 5 


(i) The points on the graph corresponding to tabular points in the 
domain lie on a straight line, but the graph itself need not bea straight 
line. 

(ii) The graph is not a straight line. # 


Solution 6 


First Second 
x x+sinzx Differences Differences 


0 0 
1 1 ; 0 
2 2 0 
3 3 
4 1.5 
3 0.5 
5 3.5 


f (x) 


Graph of x» x + sint™x (x€[0,3] ) 
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Solution 3 


Solution 4 


Solution 5 


Solution 6 


4.1.4 Summary 


In this part we have shown that the images of a tabulated function, 
corresponding to values between known tabular values, can be con- 
veniently calculated using linear interpolation, provided that within the 
interval being used for interpolation the graph of the function is reasonably 
close to a straight line. Images corresponding to values outside the tabular 
points can also be found in a similar way, but extrapolation can be 
dangerous unless we have some knowledge of the function outside the 
tabulated range. 


4.2 DIFFERENCE TABLES AND OPERATORS 
4.2.0 Introduction 


We saw in the preceding section that both for interpolation and for 
extrapolation it was useful to attach a difference table (that is, one or 
more columns of differences) to the tabulated values of a sequence or 
function. For linear interpolation and extrapolation the difference table 
need only include the first differences of the tabular values of the sequence 
or function, but when linear methods are not sufficiently accurate because 
the graph of the function is not a straight line, (as in the Highway Code 
example used in the preceding section; see also Exercise 4.1.3.5 (i)), we 
may need to include in the table columns of second differences, and 
perhaps also third differences (the differences of successive entries in the 
second-difference column), or differences of even higher order. The 
usefulness of difference tables is by no means confined to extrapolation. 
We also use them for interpolation; the resulting methods are capable 
of higher accuracy than the linear interpolation method discussed 
earlier. They make this possible because the second differences, by show- 
ing how fast the first differences are changing as we move along the table, 
give an indication of the deviation of the graph from a straight line (see 
figure) and can be used to correct for this deviation. 
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Non-linear interpolation will be considered in Section 4.3 of this unit. 


A further application of the difference table that is sometimes useful is 
to detect a blunder in the tabulated values of the function. This applica- 
tion will be considered in Section 4.4 of this unit. 


Before we can deal with either of these applications, however, we shall 
need to look into the structure of the difference table itself in more detail. 


4.2.1 The Difference Operator 


The structure of the difference table is determined by two factors: how 
the original tabular values are constructed, and how the difference 
table is built up from these tabular values. We consider the original 
tabular values first. These are the images of the tabular points x,, X2,...,X, 
under the given function f. Up to now the tabular points have been 
ordered only by magnitude. Now, to simplify the theory, we shall make 
explicit a requirement that was in fact satisfied in all the examples we 
have considered: that is, that the tabular points be equally spaced. The 
spacing between the tabular points can be any positive number; it is 
usually denoted by h (another way of saying this is that the first differences 
of the sequence of tabular points are all equal to h). With this simplifica- 
tion, both the tabular points and the tabular values are formed by applying 
definite mappings to tabular points, and we have the structure shown 
below, where the horizontal arrows indicate an application of the function 
f, and the vertical arrows indicate an application of the function 


add h:x-—> x + h_ (xeER) 


22. 
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The second factor determining the structure of the difference table is 
the method of forming the table itself by repetitions of a single basic 
binary operation; this operation is to subtract two successive entries 
in a column and enter the result at the right, as shown in the next diagram. 


f(x, ) 


= (x2) — (x) 
«) = 


sre] + ts) -f00) 


(xs) 


This diagram provides a description of the structure of any difference 
table; the basic operation it uses is a binary operation, acting on two 
numbers in the table. 


In the case we are considering here, with the tabular points equally spaced, 
there is another way of looking at the columns of differences. To do this 
we make use of the fact that x, — x, = h, x; — x, =h, etc., so that the 
above diagram can be reconstructed as 


f(x, ) 
——_—_——_——> f(x, +h) -f(x,) 


ae SE 


See ie 4 ee 
f(x;) 


This representation shows that the column of first differences of f can be 
regarded as a table of the new function 


xt—> f(x + h) — f(x) (xe R) 
with the same tabular points x,, x,,.... 


Here we have an operator of the type discussed in Section 1.1.7 of Unit 1, 
Functions. It takes any function f with domain in R and maps it to the new 
function defined above. Since for given h the new function is uniquely 
determined by f/f, the operator is a function whose domain is itself a set 
of functions: the set of all functions with domain and codomain both in R. 


This operator will be denoted by A,, and is called the difference operator Definition 1 

for the spacing h. The formula defining the difference operator is ne 
A,:f*——> [x —> f(x + h) — f(x) (x,x + hedomain of f)] (fe F) Notation 1 

where F stands for the set of all real functions. (We define a real function Definition 2 


to be a function whose domain and codomain are sets of real numbers.) 
If we omit the domain of the image function for brevity, this formula 
can be written more simply as 


A,:f'*—— [x f(x + h) — f(x)] (fe F) Notation 2 


An alternative way to state the definition of A, is to specify the image 
of any element f in its domain: 


Af) = [x f(x + hy FO AS e F) Notation 3 


where again the domain of the image function is omitted for brevity. 
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Example 1 


Consider 
fix-— 1+ 2x 4+ x? (xeER) 


We wish to find A, ,(f). Note that we have now specified h, 1.e. h = 0.2. 
Therefore 


f(x + h) = f(x + 0.2) = 1 + 2x + 0.2) + (x + 0.2) 
It follows that 
Ay (f) = [xt {1 + Ax + 0.2) + (x + 0.2)?} 
— {] + 2x + x*}] (x € R) 


=[x-— 0.4x + 0.44] (xe R) % 


Exercise 1 


If f,, fo, f3, are defined by 
fy xe 2x= (xe KR) 
jue xe) 
fx 1 ree 


find A.(f;), Ao.7(f2), and Ao.o1(J3)- ¥ 


The operator A, maps the original tabulated function f to A,(f), and the 
images of x,,x,,... under A,(f) are tabulated in the column of first 
differences. By a second application of A, we can obtain the function 
A,(A,()); the images of x,,x,,... under this function are tabulated in 
the column of second differences. 


Our previous diagrammatic form of the difference table now becomes 


f(x,) 


Anft(x:) 


f(x 


we 


AnAnt(x) 
ont 


i, es ili.” 


[Recs J+ An Anta) 


t(x 


ee 


Ante) 


f(x, 


Milt Wi a 


Using the notation for composition of functions introduced in Section 1.2.2 
of Unit 1, Functions, we can write A,(A,(f)) = A,°A,(f), which we 
further abbreviate to A2(f) or, omitting the brackets entirely, to Aj /f. 
This notation can be extended in an obvious way to obtain the further 
differences, so that, denoting the image of the element x under the function 
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Example 1 


Exercise 1 
(3 minutes) 


Aif by A; f(x), where ne Z*, our general difference table now takes the 
form 


f(x,) 


sy 
a} aay 


f(x.) subtract }—» A’ f(x,) 
\ = \ 


=< AM t0c) 


A°pt(x:) 


Fem} anid 


f(x; 


The quantities Aj f(x) are called nth differences (for any positive integer 
n). The operator Aj is called the nth difference operator for spacing h. 


Exercise 2 


If f,, f, and f, are defined by 
Joe oy (x € R) 
[Ce aaa (x € R) 
{,:%>-— 3x" + Jee 


find AZ(f,), A>.3(f2), Ai(f3). oe 


Exercise 3 


Complete each of the following statements by filling in the boxes: e.g. in (i) 
A,(x'—— sin x) =| [x*-——> sin (x + h) — sin x] 


(All unspecified domains are R or F as appropriate.) 


ee a ee 
Gi) Aysings)= [eae eA | 
Ae 
eee 
a ee ge = elie 
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Definition s 
Definition 4 


Exercise 2 
(3 minutes) 


Exercise 3 
(5 minutes) 


FM 4.2.1 


Solution | Solution 1 
As( fi) = [X'*— fi(x + 5) — file) (ve R)) 
= [x-—— 2(x + 5) — 2x (x € R)] 
= igi? 1 (xe R)] 
Ay +(f3) = [x 1.4x + 0.49 (xe R)] 
Ao.o1(f3) = [xt 0 (x € R)] = 
Solution 2 3 Solution 2 


From the solution of Exercise 1 we have 
A;(f,) = [x 10 (x € R)] 
Hence 
AS(f1) = A;(A5f;) 
= fx+—+ 10 — 10 (x € R)] 
a [Xho Gy (x € R)] 
We also have from there 


Ay (fy) = [xt 1.4x + 0.49 (xe R)] 


Hence 
Ae 4(f) = [x {1.4(x + 0.7) + 0.49} 
— {1.4x + 0.49} (x € R)] 
se, {| xt. 1). 95 (x € R)] 
Finally 
A, Us) = be ee SP + xe + 
—{3x* + 2x! (x € R)] 
= [x-—> {3x3 + 9x? + 9x +3 4 2x + 2} 
—{3x? + 2x} (x € R)] 
= [x 9x7 + 9x +5 (xe R)] 
and 
A?(f3) = [x (Ax + 1)? + Wx + 1) + 5} 
—{9x? + 9x +5) (xeER)] 
= [x-— 18x + 18 (xeER)] & 
Solution 3 Solution 3 


(ii) sin(x + h) — sinx 
(iii) sin(2 + h) — sin2 
(iv) A?(x-——> sin x) = A,(x+-—> sin (x + h) — sin x) 
= [x-—— sin (x + 2h) — sin(x + h)] 
—[x+— sin (x + h) — sin x] 
= [x-——> sin (x + 2h) — 2sin(x + h) + sin x] 
(v) Ag(x-— x?) = Ap(x-—> (x + h)* — x°) 
= A?(x-—> 3x7h + 3xh* + h’) 
= A,(x-— {3h(x + h)? + 3h?(x + h) + h°} 
—{3x7h + 3xh? + h°}) 
= A,(x-— 6h?x + 6h?) 
= [x-—>{6h?(x + h) + 63} — {6h?x + 6h?}] 
= [x-—> 6h] i 
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You may find the following two exercises quite difficult. If so, try to 
understand the hints and solutions. Do not spend too long on them but, in 
any case, note the result of part (i) of the first exercise in the form given 
at the end of the solution. 


Exercise 4 


(i) Is A, compatible with addition on F? If your answer is YES, then see 
if you can recognize the induced binary operation in the image set. 

(ii) Is A, compatible with multiplication onF? If your answer is YES, then 
see if you can recognize the induced binary operation in the image set. 


(For the definitions of compatibility and induced binary operation see 
Unit 3, Operations and Morphisms.) Some hints relating to this exercise 


are given below. a 
Exercise 5 
If fand ge F are such that A,(f) = A,(g), show that 

j= E+? 
where p is a periodic function with period h.* What more can you say 
about p if A,(f) = A,(g) for all he R? e 


Hints for the solution of Exercise 4 


In order to get to grips with a problem of this type which requires a very 
general result, it is helpful to consider some simple special cases (Polyat 
pages 190-199). 


For example, the following two functions 


fixes (x € R) 
and 
frixe— x? +4 (x € R) 


have the same image: 


Au f,}ix-— ake + dee R) 
and 
A,(fo):x*-—— 2hx +h? (xe R) 


as you can easily check. 
Also 

ee cameras 3 (x € R) 
and 

23x + 2 (x € R) 


have the same image: 


Adjejix*—h (x € R) 
and 
A,(g2):x'——> h (x € R) 


So, instead of considering compatibility in general, let us first see if it 
works for these special cases: e.g. 


is A,(f, + 21) = A,(f2 + 82)? 
and 
is Ant, X 81) = Anl(f2 X 22)? 


When you have answered these questions you should be able to answer 

at least one of (1) and (ii). 

* A function f with domain R is said to be a periodic function with period h if f(x + h) = f(x), 
for all x € R. The graph of such a function “‘repeats”’ itself at intervals of length h. E.g. the 
sine function is periodic with period 27. 


+ G. Polya, How to Solve it, Open University ed. (Doubleday Anchor Books 1970). This book 
is the set book for the Mathematics Foundation Course: it is referred to in the text as Polya. 
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Exercise 4 
(10 minutes) 


Exercise 5 
(10 minutes) 


Hints 


Definition 5 


FM 4.2.1 


Solution 4 Solution 4 
We use the notation introduced in the hints and deal with case (11) first. 
AWS: X 1) = A,(x— x*) 
= [x-— (x + h)> — x?] 
AS x 82) = Ay(xt— x? + 2x* +x + 2) 
= [x-—> {(x + hy? + Ax +h)? + (x + h) + 2} 
—{x? + 2x? +x + 2} 


and we can easily see that A,(f; x 21) # A,(f2 x 2). So this one example 
shows that A, is not compatible with multiplication on F. 


The above illustrates an important point: whenever we wish to decide 
whether a general statement about the elements of a set is true or false, 
then if we can find any elements of the set for which the statement is 
false, then it is false. On the other hand, if we find one element of the 
set for which the statement is true, this does not prove that it is true for 
all elements of the set. In this case, our general statement Is 


‘A, is compatible with multiplication on F”’ 


and this is a statement about all the elements of F. We have found four 
elements f,, fo, £1, 22, for which the statement is false; therefore it is 
false. 


On the other hand, as you probably found if you followed through our 
hint, the statement 


“A, is compatible with addition on F”’ 


is true for f,, fy, £1» 82. SO we have not yet reached a conclusion on (i). 
We can now either continue our search for elements F for which the 
statement is false, or try to prove that it is true, whatever elements of F 
we choose. The course we adopt depends on our intuition. Do we feel 
that it is true, or do we feel that it is false? If our intuition is not yet 
sufficiently developed in this problem to influence our feelings we should 
try more examples. 


Finally, in this case, we will have to sit down and prove that the statement 
is true, as follows: 


Let f,, fo, 21, 22 € F and be such that 
Afi) = Ai fa) Equation (1) 
Ai(g1) = A,(g2) Equation (2) 
Then 
Afi + 81) = A,(x'— fi(x) + 81(%)) 
= [xr {file + h) + aie + A} 
—{ fix) + g100}] 
= [xr —> fi(x + h) — f,0)] 
+ (xg + AP Fe 
= Afi) + Ailes) 


Similarly A,(f, + 22) = A,(f2) + Ar(g2). It follows from Equations (1) 
and (2) that 


AWS: + 81) = Anl(fo + 82) 


and since f,, fo, 2;, 22 are any elements of F, that A, is compatible with 
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addition on F. The induced binary operation [J on the image set is defined 
by 


Af) O Ag) = A,(f + g) forall f,geF 


and from our working above we recognize [_] as the addition of functions, 
iz. 


Af + g) = AS) + A,(g) a 
Solution 5 
Since 
Af) = re 
Af) — Aig) = 


where O here stands for the constant function 

x-——*Q- (xeR) 
For a real function g, we define — g by 

~~: =e 
where — g has the same domain as g. Then we can write 

AWS) — Ang) = An(f) + (—Ax(g)) = Af) + Ai(—8) 
and by the result of Exercise 4 we have 

AWS + ( =O or Aff—g)= 

Now, if we put p = : — g, then A,(p) = O, so we have 

A(x + h) — p(x) = 


for all x € R, so that p is periodic with period h, from which the required 
result now follows, viz. f = g + p. 


If Equation (3) is also true for all he R, then, putting x = 0, we have 


p(h) — p(O0) = 
and so 

p(h) = p(0) 
for all he R, ie. p is a constant function, whose one image is p(0). (For 
the definition of a constant function see Unit 1, Functions.) & 
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Solution 5 


Equation (3) 


4.2.2 Differences of Polynomials 


When you extrapolated the Highway Code table of stopping distances 
discussed in Section 4.1.3 to 70 miles per hour, you used the fact that the 
second differences of this table were all the same. When you found 377 
by extrapolating a table of squares that stopped at 367, you again used 
the fact that the second differences were all the same. Perhaps you 
wondered whether there were any other functions for which the second 
differences were all the same, or whether the differences for a table of 
cubes would have any similar. property. 


Following our argument similar to that of Exercise 4.2.1.5, we could 
investigate real functions, f, for which A? f is a constant function for all 
he R, and try to deduce what the f looks like. This would certainly be a 
satisfactory approach, but it could prove quite difficult. So we have 
chosen the somewhat easier, but less satisfactory approach of asking you 
to verify the result given in the following exercise. 


Exercise | 
Verify that for the function 
f:x-— ax* + bx +c (xeER) 


(1) A, f is a linear function, 
(ii) A? f is a constant function. cd 


From this last exercise it follows that a general function with the required 
property that its second differences are all the same is 


x——t ax? + bx +e (xe R) 


It does not, however, follow that this is the only type of function whose 
second differences are constant (whatever h), although this is in fact true. 
Any expression of the form ax* + bx + c(witha # O)iscalleda quadratic 
polynomial in x, and a function that maps x to a quadratic polynomial 
in x is a called a quadratic function. 


Exercise 2 


The graph of a quadratic function is a parabola. If you are not familiar 
with this curve you may like to choose numerical values for a, b, c and 
sketch one such curve. & 


The problem we solved can be generalized: can we find a general (real) 
function with constant third differences, or indeed with constant mth 
differences where m is any positive integer? Try to guess the answer 
before proceeding. A plausible guess for a general function with constant 
third differences is 


jfix-— ax? + bx* +ex +d (xeER) 


where a, b, c, d are any real numbers. Any expression of the form 
ax? + bx? + cx + d (with a ¥ 0) is called a cubic polynomial in x, and 
the function f is a cubic function. Taking the first differences of f we have 


A, f(x) = {a(x + h)> + b(x + h)? + cx +h) +d} 
— {ax + bx* + cx + d} 
3ahx? + (3ah” + 2bh)x + (ah? + bh? + ch) 


The important thing to notice is that the right-hand side is a quadratic 
polynomial in x; that is, we have shown that 


A, (cubic function) = (quadratic function) 
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Discussion 
x * 


Exercise 1 
(2 minutes) 


Definition | 
Definition 2 


Exercise 2 
(3 minutes) 


Main Text 


+ 


Definition 3 
Definition 4 


Since we already know, by Exercise 1, that 
A, (quadratic function) = (linear function) 


and 


A, (linear function) = (constant function) 


it follows that any cubic function has constant third differences. 


This argument can be generalized. The most general (real) function of 
the same type as a cubic or quadratic function is 


f iX-—Fa,X" + yx” | +++ bax +d, (xeER) 
where n is any positive integer or 0, and a,,d,_1,-.-,4,,@o are any real 
numbers, called the coefficients. 


Provided that a, 4 0, the expression a,x" +--+ + dg is called a poly- 
nomial of degree n and the corresponding function a polynomial function 
of degree n. You can complete the argument for yourself. 


Exercise 3 
Which of the following are polynomials? 
(i) x* — 6x + 1, (ii) (x — 3)(x + 2), 


x +5 


———, (iv) 2x + 4, (v) 7. 
x —3 


(111) 
Once again, if you find the following exercise difficult (or if you are short 
of time) try to understand the solution. In any case you should note the 
result of the exercise. * 


Exercise 4 


If f is a polynomial function of degree n, is A, f a polynomial function 
and, if so, what is its degree? What do you conclude about the difference 
table of a polynomial function, and, in particular, about the nth difference 
of a polynomial function of degree n? & 
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Definition 5 


Definition 6 


* xe 


Definition 7 


x*x 


Exercise 3 
(2 minutes) 


Exercise 4 
(2 minutes) 


Solution ] 


(i) A, f = [x-— {a(x + h)? + b(x + h) + c} 
—{ax* + bx + c} (x € R)] 
= [x-— 2ahx + ah? + bh (xe R)] 


which is linear. 


(ii) Aff = [x-—— (ah(x + f+ al* + bh} 
—{2ahx + ah? + bh’ (x € R)] 
= [xt——+ Jai (x € R)] 


which is constant. s 


Solution 2 


With b = c = 0, specimen curves are 


For any other choice of a, b and c, a similar curve is obtained, displaced 
from the origin. a 


Solution 3 


(i) is a polynomial (quartic). 
(11) is a polynomial (quadratic). 
(111) is not a polynomial. 
(iv) is a polynomial (linear). 
(v) is a polynomial (constant). xs 
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Solution | 


Solution 2 


Solution 3 


FM 4.2.2/4.2.3 


Solution 4 Solution 4 


fix a,x" + ay yx") +++ +ayx +a, (xER) 
A, f :X'—> {a,(x +h)” + a,— (x + hy" * + +++ + ay(x + h) + ao} 
—{a,X" + a, 1X") +++» + a,x + ao} (xe R) 


We now expand each of the brackets (x + hj‘, k = 2,3,...,n, using the 
binomial expansion, e.g. 


n 


) te 6 ee h” 
2 


n 
(x + hy’ = x" 4+ [thm co | 


Thus {a,(x + h)" — a,x" is 
{Ay(x" + nx" "h +--+ +h") — a,x" 
= a,(nx""h + --- +h") 
= polynomial of degree (n — 1) 


We can similarly expand each of the terms, and then collect all the results. 
But the essential thing to notice here is that we start with f, a polynomial 
function of degree n, and we recognize A, f to be another polynomial 
function, but the highest power of the variable x is now (n — 1), ie. A, f 
is a polynomial function of degree (n — 1). 

Thus A, (nth degree function) = (function of degree n — 1). 

Similarly 


A? (nth degree function) 
= A, (function of degree n — 1) 


= (function of degree n — 2) 


and 
A; (nth degree function) 
= (function of degree n — n) 
= (constant function) eo 
4.2.3 Summary 4.2.3 
In this section we examined the behaviour of successive columns of the Summary 


difference table for a tabulated function, and showed how they could 
be regarded as being generated by successive applications of the difference 
operator A,, to the original function. This operator provides a con- 
venient notation for expressing formulas involving differences succinctly. 
It will be shown in a later unit that it has affinities with the differentiation 
operator. A, is compatible with the operation of addition (and subtrac- 
tion), which is an important and useful result. 

We then went on to show that the nth differences of a polynomial function 
of degree n are all equal. Conversely, if we find that the nth differences 
in a difference table are all equal (whatever h), we may assume that the 
function generating the table is a polynomial of degree n. 
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4.3 NON-LINEAR INTERPOLATION 


4.3.0 Introduction 


In one of the exercises you did earlier in this unit (Exercise 4.1.2.3) you 
saw that linear interpolation tended to be more accurate the smaller 
the spacing of the tabular points. The designers of good tables of 
commonly-used functions, such as the logarithm and trigonometric 
functions, take care that the tabular spacing is small enough to make 
linear interpolation accurate and convenient. For a table that will not 
see so much use, however, the designer may well choose to economize 
by computing the value of the function for relatively few tabular points ; 
he is particularly likely to do this if each tabular value demands a lot 
of computing effort and if the resulting table will be used only once 
because it arises from a unique situation, as in the case of the function 
mentioned in the introduction to this unit, which describes the lifting 
effect of the air on particular parts of an aeroplane wing under particular 
flying conditions. In such cases the tabular spacing 1s likely to be too 
large to justify linear interpolation and more sophisticated methods are 
necessary. 


The purpose of this part of the unit is to show you one such method, 
in which the tabulated function is approximated between the tabular 
points not by a linear function but by a polynomial function. You may 
ask : ‘What is special about polynomial functions; why not use some 
other function such as the sine or cosine?’’ One reason is simply that 
polynomial interpolation is very convenient, largely because of the nice 
properties of the differences of polynomials which you studied in the 
previous section ; and convenience is a very important factor in making a 
choice of numerical methods. 


A further reason for using polynomials is contained in a theorem proved 
by a German mathematician, Weierstrass, who lived in the last century. 
This theorem (whose proof we shall not consider here) states that any 
continuous* function can be approximated over any desired interval 
to any desired accuracy by means of some polynomial. Unfortunately 
Weierstrass’ theorem has the annoying feature of so many so-called 
existence theorems in mathematics: it tells us that the polynomial exists, 
but not how to find it. In the rest of this section we shall not use Weierstrass’ 
theorem except to give confidence in the ultimate validity of polynomial 
approxiraation methods, and concentrate instead on practical methods 
for finding approximating polynomials and for interpolating with their 
help. 


* The term continuous in this context means that the graph of the function is continuous: 
i.e. there are no breaks or jumps in the curve. The concept will be studied more thoroughly 
in Unit 7, Sequences and Limits I. 
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4.3 


4.3.0 


Introduction 
* 


Karl W. T. Weierstrass (1815~-1897) 


4.3.1 Fitting a Linear Function 


The very simplest type of polynomial interpolation is the same thing as 
linear interpolation, which we have already considered in Section 4.1.2: 
for the linear functions used there to approximate the tabulated functions 
are, by the definition of ‘polynomial function”’ given in Section 4.2.2, 
none other than polynomial functions of degree 1. Before discussing 
non-linear interpolation, therefore, we recapitulate the principles of 
linear interpolation using a slightly different viewpoint from the one 
used in the section devoted to this topic. 


In linear interpolation we approximate the function between two succes- 
sive tabular points, say x, and x,,,, by a linear function that fits (ie. 
has the same tabular values as) the tabulated function at those two 
tabular points. (See figure.) 


This linear function may be denoted by /, where 
l:x+—>ax +5 c= 28 yo eee 


and a and b are two real numbers. 


Exercise ] 
Why did we use [x,, x,4,], rather than R, for the domain of |? 


We have stipulated that / must fit the tabulated function at x, and x,,,; 
that is, 


ax) = {(x,) 
Uxy44) = f (X41) 


These two conditions are just enough to determine the two constants 
a and b in the definition of /; for, they are equivalent to 


x,a + b = f(x,) 
Xe414 +b = f(Xq41) 


and since the tabular points x,, x,,, and the values f(x,), f(x, ) are 
known, we can treat these equations as a pair of simultaneous equations 
for the two unknowns a and b. 


Exercise 2 


Solve the equations for a and b and hence obtain an explicit formula 
for (x) in terms of x and tabular points and values. 


(The solution of this exercise requires a certain degree of facility with 
algebraic manipulation. If you do not have this facility, read the solution 
and then work through the details yourself step by step, if you have the 
time. The important thing is to take note of the result in Equation (3). 
In general, throughout this section, the technical details (some of which 
are omitted, in any case) are not as important as your understanding of 
what we are trying to do and an appreciation of the results.) = 
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Discussion 
x * 


Definition 1 


Exercise 1 
(2 minutes) 


Exercise 2 
(3 minutes) 


FM 4.3.1 


Solution 1 Solution 1 


The graph of / is to be a segment ofa straight line: not a complete straight 
line. The algebraic equivalent of this geometric condition is the restriction 
on the domain of |. Evidently, we wish to approximate to the complete 
curve like this: 


not like this: 


e 
Solution 2 Solution 2 
The solution of the simultaneous equations is 
ae FS (Xx41) =FOW 
Xe+1 — Xz 
— Xue ite) — MF ea) 
Xe+1 — Xk 
which when substituted into the formula for (x) gives 
% —x x—xX 
(x) = Att —— f(x,) + ~~ f (x4 1) Equation (1) 
k+1 — Xk Xe+1 — Xk 


We shall carry this solution a little further and eliminate x in favour of 
the variable 
~~ Xp 


Xet+1 — Xk 
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which represents the proportion in which the number x divides -the 
interval [x,, X,4,] (see figure). 


re) 6 1 

a 
1 Xx > 4 § Xxo 
——— h ———>» 


Noticing that 


Xp41 —-X x-*x 
een i | a ae ae oe 
Xe+1 — Xk Xe+1 — Xx 
Equation (1) now becomes 


U(x) = f(x) + (fe 1) - F(x )f 9, (x € [Xq, X44) 


A neater way to write Equation (2) is to use the difference operator 
defined in Section 4.2.1; it then simplifies to 


(x) = f(x) +O. An f(x) (© [xy Xe 41) & 


Exercise 3 


Use Equation (3) to estimate tan (1.444) from the 
table at the right, and compare with the true value x tan x 
(to three decimal places), tan (1.444) = 7.844. 


1.43 7.055 
144 7.602 
1.45 = 8.238 
146 8.989 


(You could, of course, answer this exercise by the methods of Section 4.1.2, 
but in order to get a feeling for our present methods, we suggest you do 
it using Equation (3).) va 
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Equation (2) 


Equation (3) 


Exercise 3 
(3 minutes) 


Solution 3 


The difference table is shown at the 
right. The interval [x,, x, ,] contain- 
ing 1.444 is [1.44, 1.45]; hence 
x, = 1.44 and 
0.004 4 
- $F 30 


Equation (3) thus gives 


tan (1.444) ~ 7.602 + 7> x 0.636 = 7.856 


xX 


1.43 
1.44 
1.45 
1.46 


tan x 


7.055 
7.602 
8.238 
8.989 


Ao.o; (tan x) 


0.547 
0.636 
0.751 


which is the estimate for tan (1.444) given by linear interpolation. The 
error of 0.012 shows that the approximation of tan x by [(x) does not 


give good accuracy in this range. 
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Solution 3 


4.3.2 Polynomial Interpolation 


When linear interpolation is not very accurate, as in the preceding 
‘exercise, it indicates that the tabulated function is not very accurately 
represented by the linear function (x) over the interval [x,,x,4,]. In 
such cases we can try to allow for the non-linearity by using a simple 
non-linear approximating function instead of a linear one. If the approxi- 
mating function is to be a polynomial, then the simplest (i.e. of lowest 
degree) non-linear possibility is the quadratic function 


qgi:x-— ax* + bx +c 


To complete the specification of this function we need values for the three 
constants a, b, c, and also a specification of the domain. Following the 
method used in the preceding section we could try to determine a, b, and c 
by requiring that q must fit the tabulated function at two successive 
tabular points, say x, and x,,,. Can you see the difficulty that would 
arise? We would get two simultaneous equations 


x2a+x,b+c=f(x,) ! 
nm, ie + Xn410 +c= F (Xu41) 


but they would not be enough to determine a, b, and c (see figure). 


To find three unknown quantities we need three simultaneous equations. 
There are various ways of obtaining a third equation; the simplest, and 
the only one we shall consider here, is to require that q shall fit the 
tabulated function at three consecutive tabular points instead of just 
two (see figure). 


Graph of the unique 
quadratic fitting the tabulated 
function at the 3 


Graph of one of the consecutive tabular points. 


many quadratics fitting 
the tabulated function at 
only 2 tabular points. 


f(x.42) 


Calling these three points x,, x, 4, X,+2, we then have the three equations 
Q(X) = X¢a + X,b +c = f(x,) 
UXe+1) = XK414 + Mab t+e= f (X41) 


UX,+2) = Xp420 + X442b + ¢ = f(X,42) 
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Discussion 
«x * 


Equations (1) 


and since the number of equations is now equal to the number of un- 
knowns, the equations now contain enough information to determine 
a, b, and c. 


It remains to specify the domain of q(x). Because of Equations (1) the 
domain must include at least the numbers x,, x,4,, and x,42, and, if the 
function is to be useful for interpolation, it must also include intermediate 
values; thus the least domain for g(x) is [x,,X,+2]. The graph of this 
function 


qixt— ax? + bx +c (xe€[X,, X,42]) 


is the one shown in the last figure. Of course, if the function were required 
(and were suitable) for extrapolation, the domain could easily be extended. 


To find the three constants a, b, c, the obvious method of proceeding is 
to solve the three simultaneous equations (1). 


There are standard techniques for solving such a system of equations; 
-you will meet some of them in one of the units on Linear Algebra. Here, 
however, we are not concerned with the techniques but only with the 
final result, which can be put in the form 


q(x) = ax* + bx +¢ 


a (x = Ma lk ~ “1227 F(x) 


(Xy ~ Ngai Xy > Xuaz 


(x ~ Rye — Xeagl 
ae ae ae oo Span) et) 


(% = Et = Rye) 
eae — X)(Xp42 — Xe+ yf Mee?) 


The expression on the right is called Lagrange’s interpolation polynomial, 
it is the analogue of Equation (1) of 4.3.1 for the linear case. (There is 
no point in your learning this formula by heart.) 


Just as in our treatment of the linear case we can simplify Equation (2) 
by using the variable 6, related to x as in the figure: 


Then Equation (2) becomes (after some technical details, which are 
omitted) a quadratic polynomial in @: 


Q(x) = 767 { f(Xn42) — 2F O41) + f(x,)} 
+ Of —Sf (Xp42) + 2F(%41) - 3h (x)} + f(x) 


This formula is not very important in itself; it is only written down so 
that you can see whether you recognize the coefficient of 6? (i.e. the 
number multiplying 6? in the first term on the right). Apart from the 
factor 4 this coefficient is A? f(x,). The coefficient of 0 looks a little more 
complicated but it can still be written in the terms of the difference 
operator; it is A,f(x,) — 4A2f(x,). Using these expressions for the co- 
efficients we can write Equation (3) in the very concise form 


q(x) = f(x,) + BA, f (X,) + 708 = LARS (x) (x € (Xx, Xx4+2]) 


This is a special case of a general formula called the Gregory-Newton 
Formula. 
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Joseph-Louis Lagrange ( 


Equation (2) 


Definition 1 


Equation (3) 


Equation (4) 


Definition 2 


xe 


1736-1813) 
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Example 1 Example | 


As our illustration of how the Gregory-Newton formula is used, let us 
again consider the Highway Code table, i.e. 


Speed Stopping Distance First Second 
(mile/h) (ft) Differences Differences 
20 40 
30 7 10 
40 120 55 10 
50 175 65 10 
60 240 


We are interested in estimating the stopping distance in feet when travel- 
ling at 24 mile/h. 


In this case we would choose x, = 20 and x,,, = 30. Then 
x~% 22m 5S 


ae annie 8 poe 
Xk+1 he 30 — 20 10 


and we have h = 10; Equation (4) becomes 


4 ee. 6 
q(24) = f(20) + = x Aro f(20) + 5 x 75 x | Ajo f (20) 


2 10 
140 = 120 
ee ae 
= 40 + 14 — 1.2 = 52.8 ft & 
Exercise | Exercise 1 
oe (5 minutes) 
Use the Gregory-Newton quadratic interpolation 
formula to calculate tan (1.444) from the table at x tan x 
the right, and compare with the result obtained by 
linear interpolation in Exercise 4.3.1.3, and with the 143 7.055 
correct result 7.844. 144 7.602 
145 8.238 
146 8.989 
= 


4] 


Solution 1 
The difference table is shown at the “‘peen-er-ninirret rote rr reesie 
right. The number 1.444 lies in the x tan x A A? 
interval [x,,x,4 2] with x, = 1.43 nice paenacaiaasrsaee ieesanebanbmemenaes emeebmenarices 
or 1.44: either value for x, may be 143 7.055 547 
used. 144 7.602 636 89 
145 8.238 751 115 
146 8.989 
x, = 1.43 x, = 1.44 
G = 1.4 dé=0.4 
q(x) = 7.055 + 1.4 x 0.547 q(x) = 7.602 + 0.4 x 0.636 
\ssrasiepsoeey aosieeemnyteneemnananee/ 
Fes x 0.4 x 0.089 linear interpolation 
0.4 x (-0. 
pee D®) 2-485 
Z 
= 7.055 + 0.766 + 0.025 = 7,602 + 0.254 + ( — 0.014) 
= 7.846 oe 7 B42 & 


Choosing x, = 1.43, our solution agrees within 0.002 with the correct 
value. When x, is chosen to be 1.44, the agreement is exact to 3 decimal 
places. Using linear interpolation (see p. 38), we found tan (1.444) = 7.856, 
which is not very accurate. 

The general Gregory-Newton formula for nth degree polynomial inter- 
polation to the function f is 


a(x) = f(x,) + OA,S(x,) + 7000 — DARL (x,) +> 
1 
+ — 1)(0 — 2)---(@—n + 1)ARf(x,) 
The domain over which it is useful for interpolation is the interval 


[X,, X,4,]. It is the basic formula for polynomial interpolation (although 
not the most practical when the degree of the polynomial is higher than 2). 
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Solution 1 


Definition 3 


x « & 


4.3.3 Formulas from Tables 


Although the principal application of the Gregory-Newton formula is 
to non-linear interpolation, it can also be used for what is essentially 
non-linear extrapolation of polynomial functions. If the purpose of an 
extrapolation is merely to find the next member of a sequence of numbers 
suchas 1, 3, 5, 7,...or 40, 75, 120, 175, 240, .. . (the Highway Code stopping 
distances, considered earlier in this unit), then there is no need for the 
Gregory-Newton formula; we simply build up the function directly 
from the difference table as explained in Section 4.1.3. The Gregory- 
Newton formula does come in useful, however, when we want a formula 
that will give all the non-tabulated elements of the sequence. For example, 
we can use the Gregory-Newton formula to obtain a general formula 
giving the nth element of the sequence whose first five elements are 


17,17 + 27,17 + 2? + 33,17 + 2? + 37 + 47,17 + 27 + 3? 
+4? + 5*,... 
— that is, it gives us a formula for the sum of the squares of the first n 
natural numbers. Such formulas for sums of powers will be used in 
Unit 9, Integration I for calculating areas. A typical case to which the 


results are applied is illustrated in the figure ; the area between the curve 
and the x-axis is approximately a set of rectangles. 


Graph of y=x (1-—x) 


The width of each rectangle is 75; the height of the nth rectangle from the 
2 


left 1 ot . that it eke a = : 
e Is 5 101” 8° at its area 1 100 ~ 1000’ 


of the 10 rectangles can be evaluated using formulas derived in this 
section. (For further details see Unit 9, Integration I.) 

To work out the method, we consider once again the Highway Code 
table of stopping distances. 


The sum of the areas 


Ss d Differences 
Speed Stopping Distance 
(mile/h) (ft) First Second 

20 40 

30 fe “ 10 
40 120 55 10 
50 175 65 10 
60 240 
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Can we deduce from the table a polynomial formula that gives the stopping 
distance, d, directly in terms of the speed, s? That is, can we find a poly- 
nomial function p such that 


d = /(s) 
holds for all the tabular points? 


The first differences are not constant; therefore p is not of degree 1. 
On the other hand, the tabulated second differences are constant, so that 
the tabular values can be fitted by a polynomial of degree 2, i.e. a quadratic. 


The table does not prove that the degree of the polynomial is 2, nor 
even that the function s-——d is a polynomial at all. But a quadratic 
polynomial fitting all the tabulated points does exist, and the table does 
come from a physical law, so that it is good scientific method to adopt 
the quadratic as a working hypothesis until some positive reason for 
rejecting it turns up (such a reason would exist, for example, if one were 
foolish enough to try to extrapolate to supersonic speeds or even to 
speeds of 150 mile/h). See also the discussion in Section 4.1.1. 


One way of finding the polynomial function p would be to substitute 
three different tabulated values of s into the formula 


d = p(s) = as? + bs + 


together with the corresponding values of d, and solve the three resulting 
simultaneous equations for a, b, c. It is much quicker, however, to use 
the result of Section 4.3.2, where a general problem of this type was solved 
and gave us the Gregory-Newton formula (4) of 4.3.2. In the present 
notation this formula is 


He — 1) 


d(s) = d(s,) + 8A, d(s,) + 5 


A; d(s,) (s € ce Sk+ 51) Equation (1) 


where @ is defined by 


su 3 
§= 


Sp+a — Sk 


It does not matter which tabular point we call s, as long as we know 
d(s,), Ayo d(s,) and Az, d(s,). Let us take s, = 20. With this and the data 
from the table Equation (1) becomes 


ae — 1 
d = 40 + 350 + 10 \ 5 (s € [20, 40]) 
ae 1 692 
= 40 + 3006 + 50 Equation (2) 
with 
§ = Seis Equation (3) 
Substituting 0 from Equation (3) into Equation (2) we have 
s—20 _(s — 20)? 
= 40 a 
d ) + 30 10 +5 10? 
4 2 
= O+ 2 -O+ a ~2+o 
s2 
=s+ 0 (s € [20, 40]) Equation (4) 


The polynomial function s-—~d defined by Equation (4) has been 
chosen to fit the tabular values over the interval [20, 40], and since only 
one quadratic will fit three tabular points, it is the unique quadratic func- 
tion that does so. Consequently, if we wish to fit the tabular values by a 
quadratic over the tabular range, or some greater range, we must again 
use the polynomial in Equation (4). This, then, is our extrapolation 


formula: 
il ee 5 s 
ne a ae 


d - axis 


points through which 
curve passes because 
second differences 
are constant 


points through 
which curve passes 
by construction s? 
Graph of d=s *50 


10 20 30 40 50 60 


S - axis 


We know from the way it was calculated that the polynomial in Equa- 
tion (5) fits the tabular values in the interval [20,40], i.e. for s = 20, 
30 and 40. We know from the constancy of the column of second differ- 
ences that there is a quadratic to fit all the tabular values, and from the 
uniqueness of the Gregory-Newton formula that this quadratic must be 
the one in Equation (5), so that this polynomial fits the tabular values 
s = 50 and 60 as well. For values of s other than these five, the table 
does not tell us whether the polynomial in Equation (5) is an accurate 
formula for stopping distance; but, as explained earlier in this section, 
the formula is a good hypothesis for testing against whatever further 
information we may have about the source of the numbers in the table. 
As it happens, in the present case, the “further information”’ to some 
extent supports the hypothesis. If you look again at the Highway Code 
you will see that the stopping distances given are broken down into 
“thinking distances” and ‘“‘braking distances”’ (see table below), 


Distance 
ee ae Rc a aan 
Stopping Thinking Braking 
20 40 20 20 
30 75 30 45 
40 120 40 80 
50 175 50 125 
60 240 60 180 


and these two distances correspond exactly to the two terms in the poly- 
nomial in Equation (5). As a last piece of detective work, you may like to 
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Equation (5) 


work out for yourself just what physical assumptions one might adopt 
to justify the particular numbers used by the Ministry of Transport for 
the two components of stopping distance. 


Let us now return to the problem mentioned earlier: finding a formula 
for the sum of the squares of the first n natural numbers. The method of 
solving it is almost identical with the one used in the Highway Code 
example, so you can probably do it for yourself with a little help. 


FM 4.3.3 


Exercise 1 


Writing S,(n) for the sum of the squares of the first n natural numbers, 
i.e.for 17 + 27 +--+ + n?, tabulate the value of S,(n)forn = 1,2, 3, 4, 5, 6. 
What is the lowest degree of a polynomial in n that will fit these values? ™ 


Exercise 2 


Find the polynomial of lowest degree that fits S,(n) for the values tabulated 
in your previous solution. Check it by considering S,(7). (In the subsequent 
text we shall show that the formula for S,(n) is correct for every positive 


integral n.) = 
Exercise 3 

Find 

(1) the sum of the first n natural numbers and 

(11) the sum of the cubes of the first n natural numbers. a 


(If you are short of time, do not spend much time on this exercise: read 
and understand the solution, and note the results.) 
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(3 minutes) 


Exercise 2 
‘10 minutes) 


Exercise 3 
(10 minutes) 


FM 4.3.3 


Solution I Solution 1 
n S,(n) A A? A? 
1 1 
2 5 : 5 4 
3 14 7 
16 2 
4 30 75 9 5 
5 55 36 11 
6 91 
Since the column of third differences is the first that is constant, the 
polynomial is of at least the third degree. ms 
Solution 2 Solution 2 
Gregory-Newton formula with x, = 1 becomes: 
ad — 1 a(@ — 1)(@ — 2 
Re ees ee 
2 6 
with 6 = n — 1. 
Simplifying gives: 
6 + 24(n — 1) + 15(n — 1)(n — 2) + 2(n — 1)(n — 2)(n — 3) 
$,(n) = 
6+ 24n — 24 + 15n? — 45n + 30 + 2n? — 12n? + 22n— 12 
2 6 
ati +r 
= 6 
or 
n(n + 1)(2n + 1) 
S,(n) = — ee ” 
Solution 3 Solution 3 
(i) Sify} =14+24+34+---+n 


The difference table for S ,(n) is 


n S,(n) A,S,(n)  A{S,(n) 
1 1 

Fd 3 ; 1 

3 6 4 1 

4 10 5 1 

5 15 6 1 

6 21 


Since the second differences are constant, the polynomial is of second 


degree (at least). 


The Newton-Gregory formula for the quadratic polynomial S(n) is 


S(n) = S(n,) + 0A, S(n,) + 348 — 1AzS(n,) 


Ween ni 
Ne4y — Ny 2-1 
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=n-— 1 


It follows that 
Sia)=1+a—1)) x 2+ #n — 1)(n — 2) x 1 
= 4n(n + 1) 
(ii) S.f) = 1° + 2° 4374+... 4¢ 7° 
The difference table for S,(n) is: 


n S3(n) A,S,(n) AiS3(n) A?S,(n) AtS 3(n) 
l | 
8 

Z 9 19 
3 36 me 37 és 6 

64 24 
4 100 125 61 30 6 
5 225 16 91 
6 441 


S3(n) = S(n,) + 0A, S(n,) + 700 — 1)A{S(n,) 
+%0(0 — 1)(@ — 2)A}S(n,) 
+36 — 16 — 2)(@ — 3)A4S,(n,) 
Again we may take n, = 1 and @ = n — 1, and so 
S3(n) = 1 + (n — 1) x 8 + 4(n — 1)(n — 2) x 19 
+¢(n — 1)(n — 2)(n — 3) x 18 
tzg(n — I)(n — 2)(n — 3)(n — 4) x 6 


This involves a lot of calculation, which leads to the following result 


= 
S3(n) = ain + 1) 


Note 


There is a “‘trick”’ to simplify the calculation ; put 
S,(n) = 0° + 1° +---4+n° 
i.e. begin with n, = 0, and then we have 


#; ) 90 = 6 - 2) 


S,(n) =0+ 10+7 : 


(9 — 1)(6 — 2(6 — 3) 


74 with 6 = n 


= in*(n + 1)? & 


In your solution to Exercise 2 you will notice that the first differences 
of S,(n) are the squares of the natural numbers, and the function “‘square 
it” is a quadratic polynomial function; therefore S,(n) must be a poly- 
nomial of degree one higher —a cubic. Your solution also showed that 
the unique cubic polynomial that fits the values of S,(n) at n = 1, 2, 3, 4, is 


n(n + 1)(2n + 1) 
6 
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To be precise we would need to argue in the following way : 
We have 


S,(n + 1) = 174+ 27 +--+. +n? + (n+ 1) 
and 
S,(n) = 17 +27 +--- +77; 
it follows that 
A,S,(n) = S,(n + 1) — S,(n) 
= (n + 1)*, so that 
S,(n) = C(n) + p(n) 


where C(n) = cubic polynomial inn, and p(n) = periodic function of period 
11. 


p(1) = p(2) = --- = p(n) (See Exercise 4.2.1.5) 


nore then S$,(1) = C(1) + p(1), but 


S,(1) = C(1) = 1, ie. p(1) = 0 hence p(n) = 0. So that finally 


If we now put C(n) = 


= n(n + 1)(2n + 1) 


S,(n) = C(n) 6 


Consequently S,(n) must be equal to this polynomial not only for 


n = 1,2,3, and 4 but for all positive integers, and we conclude that 


— n(n + 1)(2n + 1) 


17427437 +4+---4n 7 
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4.3.4 Summary 


In this part we showed that interpolated and extrapolated values of a 
tabulated function may be calculated by the Gregory-Newton Formula 


(8 — 1) 


B(x) = f(xy) + OAKS (x4) + —S— An FO) 
6 — 1)---(@- 1 
one Oo A eantar belted 
where 
Otic 
Xp+1 — Xp 


(with the usual proviso about the danger of extrapolation). 


The formula is the basis of many which are used very widely in practical 
computation, especially in connection with a computer. (It is not, however, 
particularly suitable itself as alternative formulas can achieve the same 
degree of accuracy with considerably less calculation.) A second use of 
the formula is to deduce formulas for the sum of the elements in a sequence 
of numbers, such as the sum of powers of the natural numbers. These 
formulas will be used in a later unit on integration and are occasionally 
needed in other fields. 
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4.4 ERRORS 4.4 


4.4.0 Introduction 4.4.0 
introduction 

This section gives another application of finite differences. We feel it is 

sufficiently important and interesting to include it here, but, since subse- 

quent units do not depend on this section, you can omit it if you are short 

of time. 


Up to now we have treated the tabular values as the exact values of the 
function at the tabular points. This is, however, an over-simplification. 
Tabular values are almost always inexact, if only because of round-off 
errors; moreover in all too many cases, occasional tabular values are 
not even approximately correct because of some blunder either in finding 
the value of the images of the function or in copying the numbers into 
the table. In this section you will learn how to recognize and allow for 
the effect of round-off errors when using a difference table, and how the 
difference table makes it possible, in favourable cases, to locate and even 
to correct a tabular entry that is wrong because of a blunder. 


4.4.1 Blunders 


4.4.1 
We consider blunders first because their effect on the difference table is Discussion 
more dramatic than that of round-off errors. Here are two six-figure : 
tables of values for the cosines of the numbers from 0.512 to 0.518 at a 
spacing of 0.001. One of the tables contains a deliberate wrong number, 
such as could arise from a copying error. By comparing the two tables 
you can see which tabular point has a wrong tabular value against it 
in one of the two tables; but can you tell which table is the wrong one? 
Table I Table II a 
x ? cos x x ? cos x 
0.512 0.871 766 0.512 0.871 766 
0.513 0.871 276 0.513 0.871 276 
0.514 0.870 785 0.514 0.870 785 
0.515 0.870 293 0.515 0.870 239 
0.516 0.869 800 0.516 0.869 800 
0.517 0.869 306 0.517 0.869 306 
0.868 811 0.518 0.868 811 


One way to find out whether Table I or Table II is the one with the error 
at x = 0.515 is to construct their difference tables (the decimal point is 
usually ignored in doing this): 
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Table I with Differences 
Differences 
x ? cos x 


First Second 


0.512 0.871 766 


0.513 0.871 276 — —1 
0514 Ose 4. lt 
0515 0870293 44, -1 
O56: =O Ct 
7 aa: .. =! 


0.518 0.868 811 


Table II with Differences 


Differences 
x ‘cos x. = 
First Second Third 


0.512 0.871 766 _ 490 


0.513 0.871276 = 
ee eee ee 
O55 06 7 
0516 086080) 
0517 0860906 oe =I 


0.518 0.868 811 


In Table I the second differences are constant, so that the tabular values 
can be fitted by a quadratic polynomial in x; but in Table II the later 
columns of differences are very irregular, so that no simple polynomial 
gives any reasonable fit to the given tabular values. Since the graph of 
the cosine function is a fairly smooth curve, this is very strong evidence 
that Table II is the one that is in error, and that the value 0.870 239 given 
in Table II at x = 0.515 should really be 0.870 293 as in Table I. 


Not only can we use the differences to tell whether or not there is a 
wrong value in a table, but we can often use it also to locate the wrong 
value and even to correct it. The method is an extension of a method that 
experimental scientists use. In making a series of measurements of some 
quantity at a succession of different times or of different values of some 
experimental condition such as temperature, it is standard practice to 
plot the results on a graph. If it then turns out that all the points but one 
lie on a smooth curve, the experimentalist takes this as evidence that 
a blunder was made in taking the corresponding measurement and if 
possible repeats the measurement to find out what went wrong. (If the 
measurement cannot be repeated there is a strong temptation to reject 
the anomalous measurement altogether, but what is really required is 
some explanation of why it is anomalous; it may not be in error at all, 
but may indicate a significant physical result!) 


To see how the difference table can be used to detect wrong or anomalous 
values in the table let us assume that the blunder replaces the value 
that should be f(x,), in the table of f, by a wrong value which we denote 
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by f(x,) + E; thus E is the error introduced by the blunder into the 
tabular value for the tabular point x, (see Table ITI). 


Table III 
x i 
Xh-2 f(X,-2) 
Xk-1 f(X,-1) 
Xx fim + & 
Xk+1 I (X41) 
XK+2 f(X,42) 
We can regard this as the table of a function that is the sum of f and an 
“error function’’ whose tabular value at x, is E and at all the other tabular 
points is zero. In view of the fact that A, is a homomorphism with respect 
to addition, i.e. that 
A,(f + error function) = A, f + A,(error function) 
the difference table associated with Table III will be the “sum” of the 
difference table of f and that of the ‘‘error function”, which is 
Table IV 


This shows that the error E affects more and more entries in each successive 
column of differences, the affected entries forming a triangular pattern. 
In any particular column, the largest effect occurs in the entries closest 
to the original wrong entry. (The values of the errors introduced in the 
rth column of differences are proportional to the coefficients in the 
binomial expansion of (a — b)’.) 
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To illustrate the method for locating and correcting the wrong value let 
us apply it to Table II, which is repeated below with its difference columns. 


Table II with Differences 
Differences 
x ? cos x 


First Second Third 


0.512 0.871 766 


0.513 0.871 276 — ee 
0514 0870785 6 —-S55 | s65 
0515” 0870297 ng «6107S igs 
cl ceilings rrr 
0.517 0.869306 10. —1 


0.518 0.868 811 


In the first difference column, it is difficult to disentangle the contribution 
of the error E from the contribution of the tabulated function, but in 
the second and third columns the contribution of the error E pre- 
dominates, and the pattern shown in Table IV can be clearly discerned. 
The numbers in the second and third columns on Table II above can be 
fitted almost exactly to the differences of a single error E, shown in 
Table IV, if we take E = —54; for then Table IV becomes 


Table V 
0 
0 
Ps 0 : — 54 
0 — 54 
54 162 
— 54 108 
54 — 162 
0 — 54 
0 54 
0 ' 0 
0 
Thus from the differences of Table II alone we have strong evidence 
that its entry 0.870239 at x = 0.515 is a wrong value of the form 
cos (0.515) + E with E = —54, and hence that 
cos (0.515) = 0.870 239 + 54 units in last decimal place 
= 0.870 293 
This is indeed the correct value, as given in Table I. 
Exercise | Exercise 1 
(5 minutes) 


Locate and correct the error in the table of cube roots below. 


x ee 


197 5.818 648 
198 5.828 477 
199 5.838 272 
200 5.848 035 
201 5.857 776 
202 5.867 464 
203 5.877 131 
204 5.886 765 
205 5.896 369 
206 5.905 941 
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Solution 1 


The difference table of the given values is 


5.818 648 

9829 
5.828 477 — 34 

9795 +2 
5.838 272 —32 

9763 +10 
5.848 035 

9741 —3t 
5.857 776 <5 

9688 4 32 


5.867 464 


| 9667 
5.877 131 
9634 +3 
5.886 765 +30 
9604 2 
5.896 369 232 
9572 


5.905 941 


Here the third differences of the tabulated function are not quite constant, 
but the pattern is consistent with an error E = +10 which would contri- 
bute to the difference table as follows 


+10 
+10 
+10 20 


+10 —20 


—~10 + 30 
+10 
10 


Thus the difference table indicates that the value 5.857 776 at the apex 
of the triangle is in error by +10, and that the correct value is 5.857 766. 
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Solution 1 


4.4.2 Inherent Errors 


Even if there are no blunders in the measurements or calculations whose 
results are recorded in a table, the tabulated numbers are still likely to 
be in error, both because of the limited accuracy of the process that 
produces them and because the numbers tabulated are rounded-off to 
some definite number of decimal places. In Unit 2, Errors and Accuracy 
we used the name inherent errors for all errors of this type. The purpose 
of this section is to show you how such errors limit the accuracy of calcula- 
tions based on a difference table. We shall consider mainly rounding 
errors, but the same considerations apply to all inherent errors. As an 
example to illustrate the effect of rounding errors on a difference table, 


we consider the differences of a two-figure table of values of wks for 
ae 3 
£- 3130,...5 ae 


a Differences 
x ee 
3 First Second Third Fourth 

31 320.33 
oo eee eee 
33 363.00 0.66 +0.02 

22.33 +0.01 — 0.03 
34 385.33 33.00 0.67 0.00 —0.01 0.00 
35 408.33 33.67 0.67 _001 —0.01 
36 432.00 5 433 0.66 
37 456.33 


2 
; : : . 
Since 3 is a quadratic, we expect the second differences to be constant 


and the higher differences to be zero; but because of round-off errors the 
a 


x 
tabular values are not the exact values of > and consequently the 


differences of the tabular values are not exactly constant in the second- 
difference column and not exactly zero in the later difference columns. 
When using difference tables, it is important to know whether the differ- 
ences in the table reflect a real property of the tabulated function like 
the second differences 0.66 and 0.67 in Table I, or whether they are only 
differences of rounding-off error, like the third and fourth differences in 
Table I. In Table I the distinction is obvious, but is it so obvious in the 
following table? 


Differences 


x f(x) 
First Second Third Fourth Fifth 


0.25 0.247 404 9677 


0.26 0.257081 pa 

0.27 0.266 731 a ieods = ; 6:8 v9] 
0.28 0.276356 agomensttneO S eon 39 
€.29 0.285952 Co. dS tio-bmqor ot tet 
ee eS : 
ae. || ! ; 
C22 Minetee 4 .— 32 : ; 
ee ees ee 
a ee 


0.35 0.342 898 


* The illustration is taken from P. Henrici, Elements of Numerical Analysis, (John Wiley 
1964). 
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Discussion 
* 


Table I 


Table Ii* 


The differences decrease in size at first, then increase as the order of the 
differences gets higher. Can you say whether these changes represent a 
systematic trend or whether it is purely due to round-off errors? Such 
questions bring us near the’ border between our present subject, finite 
differences, and the problem of disentangling such systematic effects 
from the effects of erratic fluctuations such as round-off errors. The 
statistical approach to this type of problem may be touched on in the 
units on statistics, but here the methods of Unit 2, Errors and Accuracy 
are sufficient. We shall use these methods to calculate bounds for the 
errors in the difference table produced by rounding errors in the tabulated 
values. This will enable us to deduce that any entry in the difference 
table which is larger than this error bound must arise at least in part 
from a cause other than round-off error. This will help us to decide on 
the degree of polynomial with which we may reasonably approximate 
the tabulated function. 


For the absolute error bound in A, f(x,) = f(x,4,) — f(x,) we add the 
absolute rounding-error bounds in the separate terms f(x, ,) and f(x,), 
in accordance with the rules described in Unit 2, Errors and Accuracy. 
The absolute rounding-error bound in f(x,,,) — f(x,) is therefore 
5 +4 = 1 unit in the last decimal place. For the absolute rounding-error 
bound in 


Ait (X,) = Ant (Xp41) — Ant (%) 


we again add the absolute error bounds in the separate terms A, f(x,4 ,) 
and A, f(x,). The calculation we have just done shows the absolute 
rounding-error bound of A, f(x;,) to be 1 unit in the last place of decimals 
and that of A, f(x, ,) 1s the same, by an analogous calculation. By the 
addition law for absolute error bounds, the absolute rounding-error 
bound in A; f(x,) is therefore 1 + 1 = 2. In the same way the absolute 
rounding-error bound of A; f(x,)is2 + 2 = 4, that of At f(x,)is4 + 4 = 8, 
and, in general, 


the absolute rounding-error bound of Aj f(x,) is 2”~' units 


in the last decimal place. 


Exercise 1 


Calculate the errors produced in a difference table by round-off if the 
round-off errors in the tabular values are alternately +4 units and —4 
units in the last decimal place, and compare with the absolute error 
bound of Aj, f(x,), given above. 


Returning to the example considered in Table II we can now test the 
significance of the trend of the numbers in the difference columns. For 
instance, the absolute rounding-error bound of the fifth differences is 
2* = 16; consequently any fifth differences whose numerical value is less 
than 16 may be due purely. to rounding error. We conclude that the 
tabulated fifth differences do not give any firm evidence about the nature 
of the tabulated function. We look for those of the difference columns in 
which the entries may not be entirely attributed to round-off errors. 


Exercise 2 
Which of the differences in Table II are appreciably different from zero 
(i.e. cannot be attributed entirely to rounding)? sa 


From the answer to this last exercise we can draw the conclusion that 
there is no point in trying to fit the tabulated values of the function in 
Table II with any polynomial of higher degree than a quadratic. If we 
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Exercise 1 
(3 minutes) 


Discussion 


* 


Exercise 2 
(2 minutes) 


Discussion 


* 


tried to use any higher degree we would be adjusting the polynomial to 
the rounding errors and not to the function itself. The implication is that 
for interpolation in Table II a quadratic interpolation formula, such as 
the quadratic Gregory-Newton formula, given by Equation (4) of Section 
4.3.2, gives the highest accuracy that this table can possibly yield. 


Exercise 3 


What is the degree of the optimum interpolation polynomial for interpola- 
tion in the following table? Use it to find tan (1.4975). 


x tan x 


1.495 13.1680 
1.496 13.3447 
1.497 13.5262 
1.498 13.7127 
1.499 13.9043 
1.500 14.1014 
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Exercise 3 
(3 minutes) 


Solution 1 
First Second Third Fourth 
Diff. Diff. Diff. Diff. 
1 
7 
—| 
ay: 
tL -35 
5 —2 8 
—- — | 4 
—5 \ z sa —8 
, 2 
ee —% 
2 


The differences of the errors are seen to be doubled, in this case, at each 
differencing. So we see that with this choice of round-off errors we obtain 
the absolute round-off error bound of Aj, f(x,), i.e. 2"~'. g 


Solution 2 


The first and second differences are definitely meaningful and different 
from zero. The absolute rounding-error bound of the third differences is 
2? = 4, thus any third differences whose numerical value is less than 4 
may be due to rounding error. Thus we would consider the third differ- 
ences not to be appreciably different from zero. & 


Solution 3 


Differences 


x tan x a aaa acini ec naman cscmna raaieal 
First Second Third Fourth 


1.495 13.1680 


1496 13.3447 po 48 D 

1497 13.5262 1865 50 1 ~~] 
1.498 13.7127 1916 51 

1.499 13.9043 1971 eS, 

1500 14.1014 


For second differences the absolute error bound is 2 units in the last 
decimal place; therefore the tabulated second differences are significant. 
For third differences the absolute error bound is 4; therefore the tabulated 
third differences are not significantly different from zero. Hence the 
interpolation formula giving the best attainable accuracy without un- 
necessary work, is the one obtained by treating the third differences as 
zero, and it is therefore of the second degree. 


By the Gregory-Newton formula, 


—1 
tan (1.4975) ~ 13.5262 + 0.18650 + 0.0051.” ; ) with @ = 4 
= 13.5262 + 0.0932 — 0.0006 
= 13.6188 x 
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Solution 1 


Solution 2 


Solution 3 


4.4.3 Summary 


In this last part we showed how blunders lead to a difference table of the 
form 


E 
E 
+E —3E 
E —2E 
—£ +3E 
E 
—£ 


which often makes it easy to detect and correct such blunders. 


On the other hand, rounding-off errors of +4 in the last decimal place 
lead to error bounds for successive differences of 1, 2, 4, 8 respectively. 
Hence, if we find the magnitudes of the differences beyond the rth do not 
exceed 2”~' in the last decimal place, we can conclude that the function 
is a polynomial of degree r, with round-off errors, or, to be more precise, 
that there is no point in trying to represent the function by a polynomial 
of higher degree than r. 


The methods of finite differences lead to methods for the interpolation 
and extrapolation of any continuous function and for the deduction of 
general formulas. 


This concludes our consideration of finite differences—a subject of 
vital importance in practical computing, which also sheds an interesting 
light on the behaviour of functions in general and introduces ideas which 
will be taken up in later work on sequences, integration and differentia- 
tion. 
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